00010000:00010000:2.0F:1775764755.314024:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1775764755.429893:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764755.430152:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076012800 00000100:00100000:2.0:1775764755.430166:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076012800 00000100:00100000:2.0:1775764755.430245:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6259 00000100:00100000:2.0:1775764755.430256:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+43:44943:x1862023076012800:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764755.430282:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764755.430317:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed522a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4efd expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775764755.430456:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1775764755.430640:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430657:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430669:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430684:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430691:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430697:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430825:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed522a91 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430834:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed522a91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430853:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed522a91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764755.430896:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1775764755.430900:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764755.430922:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed522a91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430935:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430941:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430947:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430952:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cee00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764755.430957:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430965:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430979:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764755.430982:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764755.430986:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.430993:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed522a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431017:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431023:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431029:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431046:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cf800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764755.431049:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431055:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431063:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x323c1321 (ffff96c1c4135300) 00010000:00010000:2.0:1775764755.431065:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764755.431068:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431073:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed522a8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431104:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed522a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4efd expref: 45 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431117:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed522a91 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4efd expref: 44 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.431135:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:2.0:1775764755.431137:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764755.431140:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43ce000, rc 0) 00000100:00100000:2.0:1775764755.431207:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+44:44943:x1862023076012800:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 953us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764755.431216:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6259 00000100:00100000:1.0:1775764755.435581:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.440074:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0F:1775764755.440916:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076013056 00000100:00100000:0.0:1775764755.440937:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076013056 00000100:00100000:0.0:1775764755.441044:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 729 00000100:00100000:0.0:1775764755.441056:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+44:2409:x1862023076013056:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764755.441074:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764755.441100:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed522a91 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4efd expref: 44 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.441120:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764755.441126:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764755.441186:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+43:2409:x1862023076013056:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 132us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764755.441193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 729 00000100:00100000:3.0F:1775764755.443584:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076012928 00000100:00100000:3.0:1775764755.443632:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076012928 00000100:00100000:3.0:1775764755.443715:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6260 00000100:00100000:3.0:1775764755.443724:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+43:44943:x1862023076012928:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764755.443743:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764755.443764:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522a98 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f04 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443858:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443873:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443885:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443901:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443908:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443914:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443977:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443984:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.443991:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764755.444046:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00000004:00200000:3.0:1775764755.444050:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764755.444072:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444084:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444093:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444100:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444106:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444113:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444118:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764755.444122:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444129:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444141:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:3.0:1775764755.444144:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764755.444149:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 3/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444165:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522a9f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444179:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444185:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444191:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444196:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764755.444198:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444203:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444211:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x1a471d3 (ffff96c2f7009200) 00010000:00010000:3.0:1775764755.444213:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764755.444216:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444221:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522aa6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444254:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522a98 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f04 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444268:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f04 expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.444281:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:3.0:1775764755.444283:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764755.444286:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9c00, rc 0) 00000100:00100000:3.0:1775764755.444386:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+44:44943:x1862023076012928:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 662us (8813us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764755.444394:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6260 00000100:00100000:2.0:1775764755.456214:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.456303:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076013184 00000100:00100000:3.0:1775764755.456316:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076013184 00000100:00100000:3.0:1775764755.456385:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 730 00000100:00100000:3.0:1775764755.456395:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+44:2410:x1862023076013184:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764755.456415:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764755.456448:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522aad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f04 expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.456468:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:3.0:1775764755.456475:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764755.456540:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+43:2410:x1862023076013184:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764755.456548:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 730 00000100:00100000:0.0:1775764755.523957:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.524480:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076013312 00000100:00100000:1.0:1775764755.524493:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076013312 00000100:00100000:1.0:1775764755.524567:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6261 00000100:00100000:1.0:1775764755.524579:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+43:44945:x1862023076013312:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764755.524603:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764755.524651:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91600/0x6e98bd47ed522ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f0b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.524736:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.524751:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.524764:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764755.524846:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1775764755.524851:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764755.524872:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.524898:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91600/0x6e98bd47ed522ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.524914:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.524936:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:1.0:1775764755.524940:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764755.524943:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ffa91200, rc 0) 00000100:00100000:1.0:1775764755.525013:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+44:44945:x1862023076013312:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 436us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764755.525021:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6261 00000100:00100000:3.0:1775764755.540847:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.540947:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076013568 00000100:00100000:1.0:1775764755.540960:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076013568 00000100:00100000:1.0:1775764755.541041:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6262 00000100:00100000:1.0:1775764755.541054:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+44:44945:x1862023076013568:12345-192.168.202.58@tcp:58:lfs.0 00000100:00100000:1.0:1775764755.541207:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+44:44945:x1862023076013568:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 155us (370us total) trans 0 rc -30/-30 00000100:00100000:1.0:1775764755.541214:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6262 00000100:00100000:2.0:1775764755.633694:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.633819:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076013824 00000100:00100000:3.0:1775764755.633830:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076013824 00000100:00100000:3.0:1775764755.633897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6263 00000100:00100000:3.0:1775764755.633907:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:44948:x1862023076013824:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764755.633934:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764755.633968:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522ac2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f12 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634058:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634074:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634086:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634101:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634108:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634237:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634246:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634253:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764755.634264:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:3.0:1775764755.634377:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634395:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634400:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634408:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634414:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764755.634419:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634427:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634440:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:3.0:1775764755.634442:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764755.634448:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634456:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522ac9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634471:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634477:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634483:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634492:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764755.634495:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634500:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634508:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x1a471d3 (ffff96c2f7009200) 00010000:00010000:3.0:1775764755.634510:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764755.634512:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634518:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522ad0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634560:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed522ac2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634573:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.634580:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:3.0:1775764755.634583:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764755.634585:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764755.634643:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:44948:x1862023076013824:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 738us (959us total) trans 4294970492 rc 0/0 00000100:00100000:3.0:1775764755.634651:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6263 00000100:00080000:2.0:1775764755.635148:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764755.649238:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764755.649318:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076013952 00000100:00100000:0.0:1775764755.649338:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076013952 00000100:00100000:0.0:1775764755.649404:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6264 00000100:00100000:0.0:1775764755.649416:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:44948:x1862023076013952:12345-192.168.202.58@tcp:54:lfs.0 00010000:00010000:0.0:1775764755.649500:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649521:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649534:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649581:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649606:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649613:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649619:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e0c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764755.649623:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649630:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649644:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:0.0:1775764755.649647:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1775764755.649652:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764755.649659:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0c00/0x6e98bd47ed522ae5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764755.649733:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:44948:x1862023076013952:12345-192.168.202.58@tcp:54:lfs.0 Request processed in 319us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764755.649742:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6264 00000100:00100000:3.0:1775764755.655229:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.655340:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076014208 00000100:00100000:1.0:1775764755.655352:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076014208 00000100:00100000:1.0:1775764755.655478:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1311 00000100:00100000:1.0:1775764755.655489:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:44948:x1862023076014208:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:1.0:1775764755.655799:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:44948:x1862023076014208:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 280us (548us total) trans 4294970493 rc 0/0 00000100:00100000:1.0:1775764755.655809:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1311 00000100:00100000:2.0:1775764755.744803:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.744888:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076014336 00000100:00100000:3.0:1775764755.744899:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076014336 00000100:00100000:3.0:1775764755.745001:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1644 00000100:00100000:3.0:1775764755.745015:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076014336:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764755.745047:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764755.745085:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522aec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f19 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764755.745154:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099768448:192.168.202.58@tcp:106: 00000100:00100000:3.0:1775764755.745267:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa06b40 going to sleep for 11 seconds 00000100:00080000:2.0:1775764755.745501:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1775764755.767939:0:24969:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:3.0:1775764755.767950:0:24969:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb mtime: 0 -> 1775764751 00002000:00010000:3.0:1775764755.767953:0:24969:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb atime: 0 -> 1775764751 00002000:00010000:3.0:1775764755.767955:0:24969:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb ctime: 0 -> 1775764751 00002000:00010000:3.0:1775764755.767957:0:24969:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x51:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:3.0:1775764755.767980:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099768448:192.168.202.58@tcp:106: 00010000:00010000:3.0:1775764755.768039:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522aec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f19 expref: 7 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.768064:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522aec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f19 expref: 7 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.768076:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9c00, rc 0) 00000100:00100000:3.0:1775764755.768135:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076014336:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 23123us (23366us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764755.768144:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1644 00000100:00100000:3.0:1775764755.775141:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764755.775277:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076014464 00000100:00100000:2.0:1775764755.775288:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076014464 00000100:00100000:2.0:1775764755.775353:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6265 00000100:00100000:2.0:1775764755.775364:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:44953:x1862023076014464:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764755.775391:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764755.775411:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f20 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.775485:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.775500:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.775523:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764755.775681:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1775764755.775685:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764755.775709:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.775734:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 24 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.775753:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 23 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.775762:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:2.0:1775764755.775766:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764755.775816:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0000, rc 0) 00000100:00100000:2.0:1775764755.775875:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:44953:x1862023076014464:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 514us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764755.775883:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6265 00000100:00100000:2.0:1775764755.782601:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.782684:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076014592 00000100:00100000:3.0:1775764755.782695:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076014592 00000100:00100000:3.0:1775764755.782932:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1645 00000100:00100000:3.0:1775764755.782944:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076014592:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764755.783010:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764755.783041:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522b01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f27 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764755.783115:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099768576:192.168.202.58@tcp:106: 00000100:00100000:3.0:1775764755.783221:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa06b40 going to sleep for 11 seconds 00000100:00100000:2.0:1775764755.785703:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099768576:192.168.202.58@tcp:106: 00010000:00010000:2.0:1775764755.785743:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522b01 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f27 expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.785906:0:8641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522b01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f27 expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764755.785923:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9c00, rc 0) 00000100:00100000:3.0:1775764755.786333:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076014592:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 3389us (3743us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764755.786344:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1645 00000100:00100000:0.0:1775764755.801981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.802083:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076014848 00000100:00100000:3.0:1775764755.802094:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076014848 00000100:00100000:3.0:1775764755.802157:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6266 00000100:00100000:3.0:1775764755.802168:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:44953:x1862023076014848:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:3.0:1775764755.802424:0:14288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].142, 136 off27296 00000100:00100000:3.0:1775764755.802515:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:44953:x1862023076014848:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 349us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764755.802522:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6266 00000040:00080000:3.0:1775764755.826944:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764755.826962:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764755.827127:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 143 count 2 00000040:00080000:3.0:1775764755.827134:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764755.827327:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099768704:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1775764755.827435:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1775764755.838633:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099768704:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764755.838975:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764755.839301:0:6532:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076014976 00000100:00100000:2.0:1775764755.839309:0:6532:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076014976 00000100:00100000:2.0:1775764755.839396:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 19 00000100:00100000:2.0:1775764755.839407:0:6532:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:44956:x1862023076014976:12345-192.168.202.58@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1775764755.839489:0:6532:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:44956:x1862023076014976:12345-192.168.202.58@tcp:900:lhsmtool_posix.0 Request processed in 83us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764755.839497:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 19 00000100:00080000:1.0:1775764755.839666:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764755.844978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.845160:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076015104 00000100:00100000:3.0:1775764755.845174:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076015104 00000100:00100000:3.0:1775764755.845270:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6267 00000100:00100000:3.0:1775764755.845281:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:44956:x1862023076015104:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764755.845320:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x97:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764755.845480:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:44956:x1862023076015104:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 200us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764755.845488:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6267 00000100:00080000:1.0:1775764755.845568:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764755.856722:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.857226:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076015360 00000100:00100000:1.0:1775764755.857237:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076015360 00000100:00100000:1.0:1775764755.857304:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6268 00000100:00100000:1.0:1775764755.857314:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:44956:x1862023076015360:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764755.857346:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764755.857371:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91600/0x6e98bd47ed522b08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f2e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.857539:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.857553:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.857564:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764755.857575:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:1.0:1775764755.857688:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91600/0x6e98bd47ed522b08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.857708:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.857717:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:1.0:1775764755.857719:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764755.857723:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ffa91a00, rc 0) 00000100:00100000:1.0:1775764755.857834:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44956:x1862023076015360:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 520us (1121us total) trans 4294970494 rc 0/0 00000100:00100000:1.0:1775764755.857860:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6268 00000100:00100000:2.0:1775764755.872213:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764755.872309:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076015488 00000100:00100000:3.0:1775764755.872323:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076015488 00000100:00100000:3.0:1775764755.872417:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1646 00000100:00100000:3.0:1775764755.872428:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076015488:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764755.872487:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.872513:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 6 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.872521:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764755.872524:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764755.872527:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.872590:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 6 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.872605:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 6 pid: 24969 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764755.872622:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1862023099768832:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764755.872709:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa06b40 going to sleep for 11 seconds 00000100:00080000:1.0:1775764755.872813:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764755.897487:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1862023099768832:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764755.897526:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764755.914459:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.915074:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076015616 00000100:00100000:1.0:1775764755.915086:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076015616 00010000:00010000:1.0:1775764755.915164:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 7 pid: 24969 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764755.915233:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1345 00000100:00100000:1.0:1775764755.915245:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076015616:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764755.915261:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764755.915285:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 7 pid: 24969 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.915300:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 7 pid: 24969 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.915325:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000570c4bc9/0x6e98bd47ed522964 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e4e expref: 7 pid: 24969 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.915351:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764755.915354:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764755.915359:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.915369:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.915426:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764755.915705:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915714:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915750:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915765:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915821:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915827:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764755.915831:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915840:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915852:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764755.915860:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed522b1d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764755.915927:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076015488:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 43500us (43721us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764755.915937:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1646 00000100:00100000:1.0:1775764755.916192:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076015616:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 948us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764755.916200:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1345 00000100:00080000:2.0:1775764755.916575:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764755.929859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764755.930204:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076015872 00000100:00100000:2.0:1775764755.930217:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076015872 00000100:00100000:2.0:1775764755.930285:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6269 00000100:00100000:2.0:1775764755.930296:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44956:x1862023076015872:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1775764755.930435:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44956:x1862023076015872:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 141us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764755.930442:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6269 00000100:00100000:2.0:1775764755.934722:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764755.935296:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076016000 00000100:00100000:1.0:1775764755.935309:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076016000 00000100:00100000:1.0:1775764755.935391:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1647 00000100:00100000:1.0:1775764755.935403:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2410:x1862023076016000:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764755.935685:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764755.935709:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f35 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764755.935738:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x51:0x0] initial LVB size: 1048576, mtime: 0x69d8050f, atime: 0x0, ctime: 0x69d8050f, blocks: 0x800 00010000:00010000:1.0:1775764755.936450:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764755.936455:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764755.936552:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.936579:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764755.936596:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ffa90e00, rc 0) 00000100:00100000:1.0:1775764755.936764:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2410:x1862023076016000:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1354us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764755.936793:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1647 00000100:00100000:1.0:1775764755.951712:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764755.952587:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076016256 00000100:00100000:0.0:1775764755.952601:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076016256 00000100:00100000:0.0:1775764755.953123:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6270 00000100:00100000:0.0:1775764755.953150:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44956:x1862023076016256:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764755.953276:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44956:x1862023076016256:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 129us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764755.953285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6270 00000100:00100000:3.0:1775764755.982051:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764755.982158:0:25201:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076016384 00000100:00100000:2.0:1775764755.982169:0:25201:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076016384 00002000:00100000:2.0:1775764755.982219:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x51:0x0] (0->1048575) req@ffff96c2c8528000 x1862023076016384/t0(0) o3->9cbd2dce-6222-4b9d-952e-2776ae7cef01@192.168.202.58@tcp:236/0 lens 488/0 e 0 to 0 dl 1775764766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764755.982232:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2c8528000 with x1862023076016384 ext(0->1048575) 00002000:00010000:2.0:1775764755.982238:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c2c8528000 00000100:00100000:2.0:1775764755.982268:0:25201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 417 00000100:00100000:2.0:1775764755.982276:0:25201:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2410:x1862023076016384:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1775764756.018918:0:25201:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2410:x1862023076016384:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 36633us (36868us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1775764756.018932:0:25201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 417 00002000:00100000:3.0:1775764756.018944:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x51:0x0] (0->1048575) req@ffff96c2c8528000 x1862023076016384/t0(0) o3->9cbd2dce-6222-4b9d-952e-2776ae7cef01@192.168.202.58@tcp:236/0 lens 488/440 e 0 to 0 dl 1775764766 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764756.018964:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2c8528000 with x1862023076016384 ext(0->1048575) 00002000:00010000:3.0:1775764756.018970:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c2c8528000 00000100:00100000:0.0:1775764756.055425:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764756.055634:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076016512 00000100:00100000:1.0:1775764756.055645:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076016512 00000100:00100000:1.0:1775764756.055705:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6271 00000100:00100000:1.0:1775764756.055716:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44956:x1862023076016512:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764756.055736:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764756.055803:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522b2b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f3c expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.055848:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.055863:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.055874:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.055986:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522b2b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 12 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.056005:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 11 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.056014:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:1.0:1775764756.056017:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1775764756.056021:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1400, rc 0) 00000100:00100000:1.0:1775764756.056091:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44956:x1862023076016512:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 376us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764756.056108:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6271 00000100:00100000:1.0:1775764756.076516:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764756.076681:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076016640 00000100:00100000:2.0:1775764756.076691:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076016640 00000100:00100000:2.0:1775764756.076751:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6272 00000100:00100000:2.0:1775764756.076763:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44956:x1862023076016640:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764756.076824:0:10681:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x97:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1775764756.076928:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44956:x1862023076016640:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 167us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764756.076935:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6272 00000100:00100000:3.0:1775764756.095243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764756.095701:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076016768 00000100:00100000:0.0:1775764756.095712:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076016768 00000100:00100000:0.0:1775764756.095802:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1648 00000100:00100000:0.0:1775764756.095813:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c852b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2411:x1862023076016768:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1775764756.095858:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095874:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764756.095877:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764756.095881:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095897:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095921:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095929:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095937:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095959:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764756.095964:0:15167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095972:0:15167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095989:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.095996:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000704f61d8/0x6e98bd47ed522b39 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764756.097229:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c852b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2411:x1862023076016768:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 1409us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764756.097241:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1648 00000100:00100000:3.0:1775764756.109841:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764756.109995:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076017024 00000100:00100000:0.0:1775764756.110005:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076017024 00000100:00100000:0.0:1775764756.110070:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6273 00000100:00100000:0.0:1775764756.110079:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44956:x1862023076017024:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1775764756.110150:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.110166:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 11 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.110191:0:14288:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.110221:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 11 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.110234:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 11 pid: 10088 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764756.110248:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099768960:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764756.110337:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8a3f300 going to sleep for 11 seconds 00000100:00100000:3.0:1775764756.123452:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764756.123528:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076017152 00000100:00100000:1.0:1775764756.123538:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076017152 00010000:00010000:1.0:1775764756.123577:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 12 pid: 10088 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764756.123655:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1346 00000100:00100000:1.0:1775764756.123666:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:2410:x1862023076017152:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764756.123682:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764756.123689:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 12 pid: 10088 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.123704:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 12 pid: 10088 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.123728:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:1.0:1775764756.123734:0:25199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.123743:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.123751:0:25199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764756.123812:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764756.123868:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:2410:x1862023076017152:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 203us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764756.123891:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1346 00010000:00010000:0.0:1775764756.124394:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1400/0x6e98bd47ed522b32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f3c expref: 11 pid: 10088 timeout: 1363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764756.124411:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099768960:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764756.124433:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124442:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124448:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124638:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124646:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124660:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124666:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764756.124670:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124678:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124689:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:0.0:1775764756.124692:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764756.124696:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764756.124702:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1000/0x6e98bd47ed522b40 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764756.124991:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44956:x1862023076017024:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 14911us (15156us total) trans 4294970495 rc 0/0 00000100:00100000:0.0:1775764756.125000:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6273 00000040:00080000:3.0:1775764756.125216:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764756.125221:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764756.125713:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1775764756.125722:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764756.140137:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764756.147705:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076017408 00000100:00100000:2.0:1775764756.147720:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076017408 00000100:00100000:2.0:1775764756.147853:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1312 00000100:00100000:2.0:1775764756.147864:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44956:x1862023076017408:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764756.148153:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44956:x1862023076017408:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 290us (8392us total) trans 4294970496 rc 0/0 00000100:00100000:2.0:1775764756.148163:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1312 00000100:00100000:0.0:1775764756.275203:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764756.275235:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099769088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764756.275337:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764756.277046:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764756.277065:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099769216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764756.277124:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764756.277177:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099769088 00000100:00100000:1.0:1775764756.277186:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099769088 00000100:00100000:1.0:1775764756.277239:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099769216 00000100:00100000:1.0:1775764756.277242:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099769216 00000100:00100000:1.0:1775764756.277260:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1775764756.277268:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099769088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764756.277299:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 501789760 pending 0 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764756.277362:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099769088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764756.277370:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1775764756.277387:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1775764756.277394:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099769216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764756.277404:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 501789760 pending 0 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764756.277430:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099769216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764756.277436:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00080000:1.0:1775764756.277453:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764756.277499:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099769088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764756.277534:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099769216:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1775764756.340121:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764756.940955:0:29326:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764756.940964:0:29326:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764756.941000:0:29326:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 143 count 2 00000040:00080000:1.0:1775764756.941006:0:29326:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764757.130186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764757.132483:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076017536 00000100:00100000:3.0:1775764757.132499:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076017536 00000100:00100000:3.0:1775764757.132579:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1649 00000100:00100000:3.0:1775764757.132591:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2409:x1862023076017536:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764757.132614:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764757.132632:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f43 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.132659:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764757.132662:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764757.132669:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.132687:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.132729:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8400, rc 0) 00000100:00080000:1.0:1775764757.132851:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764757.160824:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076017536:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 28223us (30634us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764757.160837:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1649 00000100:00100000:2.0:1775764757.200357:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764757.201544:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076017792 00000100:00100000:3.0:1775764757.201556:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076017792 00000100:00100000:3.0:1775764757.201643:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6274 00000100:00100000:3.0:1775764757.201653:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:44964:x1862023076017792:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764757.201676:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764757.201700:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522b4e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f4a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775764757.202932:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1775764757.204963:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522b55 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.204984:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522b55 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.204996:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522b55 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764757.205010:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:2.0:1775764757.205128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522b4e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f4a expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.205160:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522b55 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f4a expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.205170:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:2.0:1775764757.205173:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1775764757.205177:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0a00, rc 0) 00000100:00100000:2.0:1775764757.205253:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:44964:x1862023076017792:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 3601us (4905us total) trans 4294970497 rc 0/0 00000100:00100000:2.0:1775764757.205262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6274 00000100:00100000:1.0:1775764757.211467:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764757.218717:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076017920 00000100:00100000:3.0:1775764757.218737:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076017920 00000100:00100000:3.0:1775764757.218830:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1650 00000100:00100000:3.0:1775764757.218840:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076017920:12345-192.168.202.58@tcp:1:lfs.0 00010000:00010000:3.0:1775764757.218883:0:24969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.218903:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.218923:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.218949:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764757.218952:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764757.218955:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.218991:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.219005:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 7 pid: 8402 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764757.219028:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099769344:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764757.219123:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.219133:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 6 pid: 8405 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764757.219142:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099769472:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764757.219162:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c8551c00 going to sleep for 11 seconds 00000100:00100000:1.0:1775764757.232876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764757.236169:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099769472:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764757.238208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.238264:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099769344:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764757.238295:0:24969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764757.238327:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018048 00000100:00100000:1.0:1775764757.238334:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018048 00010000:00010000:1.0:1775764757.238377:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 7 pid: 8405 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764757.238403:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018176 00000100:00100000:1.0:1775764757.238405:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018176 00010000:00010000:1.0:1775764757.238414:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 8 pid: 8402 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764757.238431:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1347 00000100:00100000:1.0:1775764757.238438:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2411:x1862023076018048:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764757.238453:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764757.238473:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 7 pid: 8405 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238496:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 7 pid: 8405 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238523:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c1b39a1/0x6e98bd47ed522b24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f35 expref: 7 pid: 8405 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238540:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764757.238599:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076018048:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 160us (5730us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.238608:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1347 00000100:00100000:1.0:1775764757.238624:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1348 00000100:00100000:1.0:1775764757.238630:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076018176:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764757.238637:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764757.238645:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 8 pid: 8402 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238656:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 8 pid: 8402 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238669:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522b47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f43 expref: 8 pid: 8402 timeout: 1365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238678:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764757.238685:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764757.238689:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238698:0:24971:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238719:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764757.238738:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076018176:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 107us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.238745:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1348 00000100:00080000:1.0:1775764757.238762:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1775764757.238889:0:24969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238899:0:24969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238924:0:24969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238932:0:24969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238938:0:24969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238944:0:24969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8800 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764757.238954:0:24969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238963:0:24969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238975:0:24969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.238981:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000012acf4c/0x6e98bd47ed522b63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764757.239075:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076017920:12345-192.168.202.58@tcp:1:lfs.0 Request processed in 20237us (27617us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.239084:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1650 00000100:00100000:3.0:1775764757.249145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764757.253727:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018432 00000100:00100000:3.0:1775764757.253795:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018432 00000100:00100000:3.0:1775764757.253863:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1313 00000100:00100000:3.0:1775764757.253874:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dd67c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:44964:x1862023076018432:12345-192.168.202.58@tcp:35:lfs.0 00000004:00010000:3.0:1775764757.253936:0:6524:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x200000403:0x97:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522b55 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f4a expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1775764757.254108:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970498 00000001:00080000:3.0:1775764757.254628:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970499 00010000:00010000:3.0:1775764757.254663:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254680:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 43 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254689:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254697:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254705:0:6524:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 6/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254754:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254790:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 11 pid: 6521 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764757.254820:0:6524:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1862023099769600:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764757.254925:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.254935:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 28 pid: 6522 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764757.254944:0:6524:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1862023099769728:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764757.254993:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 43 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.255002:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 43 pid: 14288 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764757.255010:0:6524:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1862023099769856:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764757.255043:0:6524:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c8551a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775764757.261807:0:6524:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1862023099769600:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764757.261826:0:6524:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1862023099769728:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764757.261835:0:6524:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1862023099769856:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764757.261867:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764757.269658:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.269698:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.269744:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764757.270079:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018560 00000100:00100000:2.0:1775764757.270092:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018560 00010000:00010000:2.0:1775764757.270159:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 12 pid: 6521 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764757.270194:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018688 00000100:00100000:2.0:1775764757.270197:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018688 00010000:00010000:2.0:1775764757.270211:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 29 pid: 6522 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764757.270227:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018816 00000100:00100000:2.0:1775764757.270230:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018816 00010000:00010000:2.0:1775764757.270242:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 44 pid: 14288 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764757.270260:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1349 00000100:00100000:2.0:1775764757.270268:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:2408:x1862023076018560:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764757.270298:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764757.270305:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 12 pid: 6521 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270318:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 12 pid: 6521 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270341:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91a00/0x6e98bd47ed522b0f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f2e expref: 12 pid: 6521 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270357:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:2.0:1775764757.270362:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270370:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270377:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764757.270385:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1350 00000100:00100000:3.0:1775764757.270398:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+29:2410:x1862023076018688:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764757.270406:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764757.270411:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 29 pid: 6522 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764757.270428:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:2408:x1862023076018560:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 161us (782us total) trans 0 rc 0/0 00010000:00010000:3.0:1775764757.270433:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 29 pid: 6522 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764757.270436:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1349 00010000:00010000:3.0:1775764757.270445:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522ad7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f12 expref: 29 pid: 6522 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.270456:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:3.0:1775764757.270460:0:25199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.270466:0:25199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764757.270472:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764757.270490:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:2410:x1862023076018688:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 94us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.270504:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1351 00000100:00100000:2.0:1775764757.270512:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+44:2408:x1862023076018816:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764757.270519:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764757.270524:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 44 pid: 14288 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1775764757.270525:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1775764757.270544:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 44 pid: 14288 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270558:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522956 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e47 expref: 44 pid: 14288 timeout: 1365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270568:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:2.0:1775764757.270571:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270579:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270586:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.270620:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764757.270640:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+43:2408:x1862023076018816:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 129us (895us total) trans 0 rc 0/0 00010000:00010000:1.0:1775764757.270676:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764757.270684:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1775764757.270834:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970500 00000001:00080000:1.0:1775764757.270931:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970501 00000100:00100000:1.0:1775764757.271011:0:6524:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1862023099769984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1775764757.271065:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.271089:0:6524:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b44600 going to sleep for 11 seconds 00000100:00100000:3.0:1775764757.277456:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1350 00000100:00100000:2.0:1775764757.283401:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1351 00000100:00100000:2.0:1775764757.283462:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099769984 00000100:00100000:2.0:1775764757.283471:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099769984 00000100:00100000:2.0:1775764757.283543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1775764757.283553:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1862023099769984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1775764757.283578:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764757.283697:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1862023099769984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 146us (12630us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.283704:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1775764757.283837:0:6524:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1862023099769984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1775764757.284038:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970502 00000100:00100000:0.0:1775764757.284127:0:6524:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1862023099770112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1775764757.284164:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764757.284189:0:6524:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764757.287656:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770112 00000100:00100000:2.0:1775764757.287671:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770112 00000100:00100000:2.0:1775764757.287744:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1775764757.287754:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1862023099770112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1775764757.288051:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1862023099770112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 298us (3885us total) trans 4294967711 rc 0/0 00000100:00100000:2.0:1775764757.288060:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1775764757.288172:0:6524:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1862023099770112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1775764757.288244:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970503 00010000:00010000:0.0:1775764757.288278:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.288289:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.288296:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.288302:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764757.288307:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.288327:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.288345:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:0.0:1775764757.288349:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1775764757.288354:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.288359:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522b6a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1775764757.288834:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000405:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1775764757.288897:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].63, 64 off13064 00000004:00080000:0.0:1775764757.288920:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1265110147724ns, next at 1266110145609ns, rc = 0 00000001:00080000:0.0:1775764757.288927:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970504 00010000:00010000:0.0:1775764757.288954:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356600) 00010000:00010000:0.0:1775764757.288957:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1775764757.288964:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522b55 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f4a expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764757.289269:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dd67c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:44964:x1862023076018432:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 35396us (40132us total) trans 4294970505 rc 0/0 00000100:00100000:2.0:1775764757.289278:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1313 00000020:00080000:2.0:1775764757.289283:0:6524:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1775764757.298569:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775764757.298597:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099770240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764757.298665:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.298888:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770240 00000100:00100000:1.0:1775764757.298898:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770240 00000100:00100000:1.0:1775764757.298953:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1775764757.298963:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099770240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764757.298998:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446223872 avail 1299984384 00000100:00100000:1.0:1775764757.299056:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099770240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.299063:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1775764757.299106:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099770240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764757.333922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764757.334647:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076018944 00000100:00100000:0.0:1775764757.334660:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076018944 00000100:00100000:0.0:1775764757.334725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6275 00000100:00100000:0.0:1775764757.334736:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+43:44966:x1862023076018944:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764757.334757:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764757.334809:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522b71 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f51 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.334936:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.334952:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.334965:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.334979:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.334985:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.334991:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335097:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335106:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335113:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764757.335154:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00000004:00200000:0.0:1775764757.335158:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764757.335177:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335188:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335197:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335203:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335209:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335215:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335221:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764757.335225:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335239:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335252:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764757.335255:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764757.335260:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335266:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522b78 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335281:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335287:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335293:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335297:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764757.335300:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335305:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335405:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x1a471d3 (ffff96c2c6356600) 00010000:00010000:0.0:1775764757.335409:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764757.335413:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335850:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522b7f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522b71 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f51 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335909:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f51 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.335917:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764757.335920:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764757.335922:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1e00, rc 0) 00000100:00100000:0.0:1775764757.335999:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+44:44966:x1862023076018944:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1264us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764757.336007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6275 00010000:00010000:3.0:1775764757.362185:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764757.362908:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764757.362921:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764757.363468:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1775764757.363479:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764757.369513:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764757.369704:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019200 00000100:00100000:0.0:1775764757.369717:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019200 00000100:00100000:0.0:1775764757.369825:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 731 00000100:00100000:0.0:1775764757.369835:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+44:44966:x1862023076019200:12345-192.168.202.58@tcp:103:lfs.0 00010000:00010000:0.0:1775764757.369850:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764757.369873:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522b86 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f51 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764757.369896:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764757.369907:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764757.369953:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+43:44966:x1862023076019200:12345-192.168.202.58@tcp:103:lfs.0 Request processed in 120us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764757.369972:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 731 00000100:00100000:1.0:1775764757.383680:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764757.383753:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019328 00000100:00100000:2.0:1775764757.383802:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019328 00000100:00100000:2.0:1775764757.383858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6276 00000100:00100000:2.0:1775764757.383868:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+43:44966:x1862023076019328:12345-192.168.202.58@tcp:58:lfs.0 00010000:00010000:2.0:1775764757.383981:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.383998:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764757.384011:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1775764757.384108:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].143, 136 off27432 00000100:00100000:2.0:1775764757.384196:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+43:44966:x1862023076019328:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 329us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.384204:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6276 00000100:00100000:0.0:1775764757.644203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764757.644236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764757.644260:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764757.644281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764757.644300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.644422:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019584 00000100:00100000:1.0:1775764757.644434:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019584 00000100:00100000:1.0:1775764757.644484:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020096 00000100:00100000:1.0:1775764757.644487:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020096 00000100:00100000:1.0:1775764757.644507:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020608 00000100:00100000:1.0:1775764757.644510:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020608 00000100:00100000:1.0:1775764757.644532:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1796 00000100:00100000:1.0:1775764757.644541:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+43:2411:x1862023076019584:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.644629:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+43:2411:x1862023076019584:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 88us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.644637:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1796 00000100:00100000:1.0:1775764757.644655:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1797 00000100:00100000:1.0:1775764757.644662:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:2411:x1862023076020096:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.644692:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:2411:x1862023076020096:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.644709:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1797 00000100:00100000:1.0:1775764757.644722:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1798 00000100:00100000:1.0:1775764757.644739:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:2411:x1862023076020608:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.644798:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:2411:x1862023076020608:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 70us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.644804:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1798 00000100:00100000:1.0:1775764757.644962:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019840 00000100:00100000:1.0:1775764757.644967:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019840 00000100:00100000:1.0:1775764757.644999:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020352 00000100:00100000:1.0:1775764757.645002:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020352 00000100:00100000:1.0:1775764757.645033:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1300 00000100:00100000:1.0:1775764757.645040:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076019840:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.645069:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076019840:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 30us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.645075:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1300 00000100:00100000:1.0:1775764757.645087:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1301 00000100:00100000:1.0:1775764757.645093:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076020352:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.645118:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076020352:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.645124:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1301 00000100:00080000:1.0:1775764757.645184:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764757.648234:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648387:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648406:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648426:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764757.648483:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019712 00000100:00100000:1.0:1775764757.648493:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019712 00000100:00100000:1.0:1775764757.648546:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020224 00000100:00100000:1.0:1775764757.648549:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020224 00000100:00100000:1.0:1775764757.648564:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020736 00000100:00100000:1.0:1775764757.648566:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020736 00000100:00100000:1.0:1775764757.648585:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1799 00000100:00100000:1.0:1775764757.648594:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076019712:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.648665:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076019712:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 71us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.648673:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1799 00000100:00100000:1.0:1775764757.648688:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1800 00000100:00100000:1.0:1775764757.648694:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076020224:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.648716:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076020224:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.648722:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1800 00000100:00100000:1.0:1775764757.648745:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1801 00000100:00100000:1.0:1775764757.648752:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076020736:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.648810:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076020736:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 58us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.648817:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1801 00000100:00100000:1.0:1775764757.648841:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020864 00000100:00100000:1.0:1775764757.648844:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020864 00000100:00100000:1.0:1775764757.648866:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019968 00000100:00100000:1.0:1775764757.648868:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019968 00000100:00100000:1.0:1775764757.648881:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020480 00000100:00100000:1.0:1775764757.648883:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020480 00000100:00100000:1.0:1775764757.648892:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076020992 00000100:00100000:1.0:1775764757.648894:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076020992 00000100:00100000:1.0:1775764757.648905:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1302 00000100:00100000:1.0:1775764757.648911:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076020864:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.648935:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076020864:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.648941:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1302 00000100:00100000:1.0:1775764757.648951:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1303 00000100:00100000:1.0:1775764757.648956:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076019968:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.648979:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076019968:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.648984:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1303 00000100:00100000:1.0:1775764757.648993:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1304 00000100:00100000:1.0:1775764757.648999:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076020480:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.649031:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076020480:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.649036:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1304 00000100:00100000:1.0:1775764757.649046:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1305 00000100:00100000:1.0:1775764757.649053:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076020992:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764757.649094:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076020992:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 42us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.649106:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1305 00000100:00080000:1.0:1775764757.649141:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764757.649144:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1775764757.649146:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764757.650086:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076019456 00000100:00100000:0.0:1775764757.650094:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076019456 00000100:00100000:0.0:1775764757.650134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 943 00000100:00100000:0.0:1775764757.650141:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c2bebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+15:2411:x1862023076019456:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764757.650181:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c2bebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+15:2411:x1862023076019456:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 40us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764757.650187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 943 00000100:00100000:1.0:1775764757.812372:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099770752:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.812440:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.812517:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099771264:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.812543:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.812568:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1775764757.812574:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099770368:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.812602:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.812625:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099770880:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.812647:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.812662:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099771392:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.812682:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.812719:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099770496:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813160:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.813183:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099771008:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813206:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.813220:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099771520:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813237:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.813254:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1775764757.813259:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099770624:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813281:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.813319:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099771136:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813390:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.813406:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099771648:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813421:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764757.813663:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770368 00000100:00100000:1.0:1775764757.813672:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770368 00000100:00100000:3.0:1775764757.813814:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770624 00000100:00100000:3.0:1775764757.813819:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770624 00000100:00100000:3.0:1775764757.813856:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1775764757.813865:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813905:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1775764757.813913:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c2bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099770368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764757.813922:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099770624:12345-0@lo:400:kworker.0 Request processed in 59us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764757.813929:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1775764757.813945:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c2bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099770368:12345-0@lo:400:kworker.0 Request processed in 33us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.813951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1775764757.813984:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770752 00000100:00100000:3.0:1775764757.813984:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099770624:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.813987:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770752 00000100:00100000:1.0:1775764757.814008:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770880 00000100:00100000:1.0:1775764757.814021:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770880 00000100:00100000:1.0:1775764757.814054:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099771392 00000100:00100000:1.0:1775764757.814057:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099771392 00000100:00100000:1.0:1775764757.814070:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099770496 00000100:00100000:1.0:1775764757.814072:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099770496 00000100:00100000:1.0:1775764757.814082:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099771008 00000100:00100000:1.0:1775764757.814084:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099771008 00000100:00100000:1.0:1775764757.814094:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099771520 00000100:00100000:1.0:1775764757.814096:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099771520 00000100:00100000:1.0:1775764757.814108:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1775764757.814113:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.814142:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099770752:12345-0@lo:400:kworker.0 Request processed in 28us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.814148:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1775764757.814159:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:1.0:1775764757.814173:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099770880:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1775764757.814192:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764757.814197:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764757.814204:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099770880:12345-0@lo:400:kworker.0 Request processed in 33us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.814210:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:1.0:1775764757.814223:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1775764757.814228:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099771392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.814254:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099771392:12345-0@lo:400:kworker.0 Request processed in 26us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.814259:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1775764757.814269:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:1.0:1775764757.814273:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099770496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764757.814586:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099770496:0@lo:400:kworker.0 00000100:00100000:2.0:1775764757.817098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1775764757.817120:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099771008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764757.817219:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099771008:12345-0@lo:400:kworker.0 Request processed in 105us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.817226:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1775764757.817250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:2.0:1775764757.817257:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099771520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764757.817289:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099771520:12345-0@lo:400:kworker.0 Request processed in 33us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.817294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:2.0:1775764757.817320:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099771264 00000100:00100000:2.0:1775764757.817326:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099771264 00000100:00100000:2.0:1775764757.817364:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099771136 00000100:00100000:2.0:1775764757.817367:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099771136 00000100:00100000:2.0:1775764757.817384:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099771648 00000100:00100000:2.0:1775764757.817386:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099771648 00000100:00100000:2.0:1775764757.817416:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1775764757.817421:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099771264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764757.817452:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099771264:12345-0@lo:400:kworker.0 Request processed in 31us (4908us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.817457:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1775764757.817484:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1775764757.817490:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099771136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764757.817515:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099771136:12345-0@lo:400:kworker.0 Request processed in 26us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.817520:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1775764757.817531:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1775764757.817537:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099771648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764757.817570:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099771648:12345-0@lo:400:kworker.0 Request processed in 33us (4147us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764757.817575:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00080000:3.0:1775764757.818067:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764757.818084:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099770496:12345-0@lo:400:kworker.0 Request processed in 3808us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764757.818091:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:3.0:1775764757.818106:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099771136:0@lo:400:kworker.0 00000100:00100000:3.0:1775764757.818120:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099771648:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.818130:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099770368:0@lo:400:kworker.0 00000100:00100000:3.0:1775764757.818130:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099771008:0@lo:400:kworker.0 00000100:00100000:3.0:1775764757.818140:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099771520:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.818144:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099770880:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.818154:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099771392:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.818165:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099770752:0@lo:400:kworker.0 00000100:00100000:1.0:1775764757.818177:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099771264:0@lo:400:kworker.0 00000040:00080000:2.0:1775764758.194304:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764758.194314:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764758.194342:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 144 count 3 00000040:00080000:2.0:1775764758.194357:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764758.194528:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099771776:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764758.194639:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c45cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764758.210196:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.210344:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099771776:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764758.210490:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076021120 00000100:00100000:1.0:1775764758.210499:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076021120 00000100:00100000:1.0:1775764758.210562:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6277 00000100:00100000:1.0:1775764758.210573:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44976:x1862023076021120:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764758.210620:0:6521:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x97:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764758.210744:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44976:x1862023076021120:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 172us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.210752:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6277 00000100:00100000:1.0:1775764758.216099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.216440:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076021248 00000100:00100000:2.0:1775764758.216451:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076021248 00000100:00100000:2.0:1775764758.216509:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6278 00000100:00100000:2.0:1775764758.216518:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44976:x1862023076021248:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1775764758.216596:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216616:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216629:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216669:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216677:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216713:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216752:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216759:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.216766:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764758.217108:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00000004:00200000:2.0:1775764758.217112:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764758.217127:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217141:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217148:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217155:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217162:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764758.217167:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217175:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217196:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764758.217199:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764758.217205:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217212:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522b94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217224:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217230:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217235:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217241:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764758.217244:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217250:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217257:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xefb1cfac (ffff96c1c4135b00) 00010000:00010000:2.0:1775764758.217259:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764758.217261:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217267:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522b9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217292:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217299:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217305:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217310:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764758.217313:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217319:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217326:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764758.217328:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764758.217331:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.217337:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522ba2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764758.217418:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44976:x1862023076021248:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 Request processed in 899us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.217428:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6278 00000100:00100000:3.0:1775764758.238230:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.248551:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076021504 00000100:00100000:1.0:1775764758.248566:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076021504 00000100:00100000:1.0:1775764758.250029:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6279 00000100:00100000:1.0:1775764758.250043:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44976:x1862023076021504:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764758.251417:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764758.251444:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522ba9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f58 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.251557:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.251572:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.251587:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764758.251602:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:1.0:1775764758.251687:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.251705:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252546:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252552:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764758.252557:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252564:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252578:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:1.0:1775764758.252582:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764758.252587:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252594:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bb0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252644:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522ba9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f58 expref: 13 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252653:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:1.0:1775764758.252655:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1775764758.252658:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522ba9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f58 expref: 13 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.252667:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1c00, rc 0) 00000100:00100000:1.0:1775764758.252925:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076021504:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 2884us (14703us total) trans 4294970506 rc 301/301 00000100:00100000:1.0:1775764758.252945:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6279 00000100:00100000:2.0:1775764758.268331:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.268395:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076021632 00000100:00100000:1.0:1775764758.268407:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076021632 00000100:00100000:1.0:1775764758.268467:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6280 00000100:00100000:1.0:1775764758.268477:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076021632:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764758.268510:0:10681:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x97:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764758.268621:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076021632:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 145us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.268629:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6280 00000100:00100000:3.0:1775764758.273704:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.273998:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076021760 00000100:00100000:2.0:1775764758.274017:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076021760 00000100:00100000:2.0:1775764758.274086:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6281 00000100:00100000:2.0:1775764758.274096:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076021760:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764758.274118:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764758.274164:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f5f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274231:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274245:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274257:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274271:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274277:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274283:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274365:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522bd3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274372:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274379:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764758.274422:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1775764758.274426:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764758.274448:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274461:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274467:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274472:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274478:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274483:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764758.274487:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274494:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274505:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764758.274507:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764758.274512:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274517:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274540:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274546:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274551:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274556:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764758.274558:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274564:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274572:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x323c1321 (ffff96c1c4135b00) 00010000:00010000:2.0:1775764758.274574:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764758.274576:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274581:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522bcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x323c1321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274614:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f5f expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274627:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f5f expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.274645:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:2.0:1775764758.274647:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764758.274649:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0400, rc 0) 00000100:00100000:2.0:1775764758.274705:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44976:x1862023076021760:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 611us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.274712:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6281 00000100:00100000:3.0:1775764758.280582:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.280889:0:6530:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076021888 00000100:00100000:2.0:1775764758.280898:0:6530:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076021888 00000100:00100000:2.0:1775764758.280958:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 8 00000100:00100000:2.0:1775764758.280969:0:6530:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44976:x1862023076021888:12345-192.168.202.58@tcp:700:lhsmtool_posix.0 00000100:00100000:2.0:1775764758.281066:0:6530:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44976:x1862023076021888:12345-192.168.202.58@tcp:700:lhsmtool_posix.0 Request processed in 100us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.281074:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 8 00000100:00100000:2.0:1775764758.285757:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.285949:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076022144 00000100:00100000:3.0:1775764758.285962:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076022144 00000100:00100000:3.0:1775764758.286028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6282 00000100:00100000:3.0:1775764758.286039:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44976:x1862023076022144:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764758.286069:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764758.286089:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522bda lrc: 2/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f66 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.286572:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522be1 lrc: 3/1,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.286589:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522be1 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.286603:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522be1 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764758.286613:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000406:0x1:0x0]: returning size 0 00010000:00010000:3.0:1775764758.286656:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522bda lrc: 0/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f66 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.286673:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522be1 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f66 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.286682:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c1c2aa3900) 00010000:00010000:3.0:1775764758.286686:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764758.286689:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764758.286754:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+15:44976:x1862023076022144:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 718us (1008us total) trans 4294970507 rc 0/0 00000100:00100000:3.0:1775764758.286796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6282 00000100:00100000:0.0:1775764758.303950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.304355:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076022400 00000100:00100000:1.0:1775764758.304368:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076022400 00000100:00100000:1.0:1775764758.304438:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6283 00000100:00100000:1.0:1775764758.304449:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+15:44976:x1862023076022400:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1775764758.304506:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764758.304533:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522be1 lrc: 0/0,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f66 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.304555:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c1c2aa3900) 00010000:00010000:1.0:1775764758.304566:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764758.304591:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.304607:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.304616:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 30 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.304638:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 5/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.304674:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 30 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.304689:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 30 pid: 10681 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.304703:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099771904:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764758.305352:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.305364:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 42 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.305375:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3770a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099772032:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764758.305406:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b02600 going to sleep for 11 seconds 00000100:00100000:1.0:1775764758.320160:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.320192:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764758.320753:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076022528 00000100:00100000:0.0:1775764758.320762:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076022528 00010000:00010000:0.0:1775764758.320838:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 31 pid: 10681 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.320890:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076022656 00000100:00100000:0.0:1775764758.320895:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076022656 00010000:00010000:0.0:1775764758.320909:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 43 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.320939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1352 00000100:00100000:0.0:1775764758.320947:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:2408:x1862023076022528:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764758.320970:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764758.320976:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 31 pid: 10681 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.320989:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 31 pid: 10681 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321018:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764758.321024:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321032:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764758.321092:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:2408:x1862023076022528:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 145us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764758.321099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1352 00000100:00100000:0.0:1775764758.321117:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1353 00000100:00100000:0.0:1775764758.321124:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+43:2408:x1862023076022656:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764758.321131:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764758.321145:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 43 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321154:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 43 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321166:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764758.321169:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321176:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321182:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321200:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764758.321220:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+43:2408:x1862023076022656:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 96us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764758.321225:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1353 00010000:00010000:0.0:1775764758.321393:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed522afa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f20 expref: 30 pid: 10681 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.321410:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099771904:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764758.321424:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ffa91200/0x6e98bd47ed522abb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f0b expref: 42 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.321434:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3770a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099772032:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764758.321456:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321470:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321475:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321496:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321506:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321514:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321556:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321563:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321568:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321575:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321581:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.321585:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321593:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321609:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764758.321611:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764758.321615:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 3/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321622:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522bef lrc: 0/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321632:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321638:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321643:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321648:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.321650:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321654:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321661:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0xbfff56cf (ffff96c2c6356100) 00010000:00010000:0.0:1775764758.321662:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764758.321665:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 2/0,0 mode: --/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.321670:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522bf6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x5:0x0].0xbfff56cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.321741:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:44976:x1862023076022400:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 17294us (17802us total) trans 0 rc -2/-2 00000100:00100000:0.0:1775764758.321749:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6283 00000004:00080000:3.0:1775764758.331456:0:9674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1266152682643ns, next at 1267152680161ns, rc = 0 00000100:00100000:3.0:1775764758.331491:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775764758.331511:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099772160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1775764758.331573:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764758.331727:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099772160 00000100:00100000:1.0:1775764758.331735:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099772160 00000100:00100000:1.0:1775764758.331804:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1775764758.331813:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099772160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764758.331839:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 501789760 pending 0 free 3887603712 avail 3656081408 00000100:00100000:1.0:1775764758.331887:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099772160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.331894:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1775764758.331938:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099772160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764758.343249:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.343284:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076022784 00000100:00100000:1.0:1775764758.343294:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076022784 00000100:00100000:1.0:1775764758.343354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6284 00000100:00100000:1.0:1775764758.343364:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:44976:x1862023076022784:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764758.343399:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764758.343425:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bfd lrc: 2/0,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f6d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.343463:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 3/1,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.343477:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.343497:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.343639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed522bfd lrc: 0/0,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.343667:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.343676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:1.0:1775764758.343679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1775764758.343682:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0400, rc 0) 00000100:00100000:1.0:1775764758.343763:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+15:44976:x1862023076022784:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 401us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.343795:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6284 00000100:00100000:2.0:1775764758.345804:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099772288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764758.345869:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764758.345923:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099772288 00000100:00100000:2.0:1775764758.345929:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099772288 00000100:00100000:2.0:1775764758.345969:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1775764758.345978:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099772288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764758.345998:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 501789760 pending 0 free 3887603712 avail 3656081408 00000100:00100000:2.0:1775764758.346054:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099772288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.346061:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1775764758.346123:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099772288:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1775764758.352521:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967711 is committed 00000001:00100000:3.0:1775764758.352536:0:9467:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000001:00100000:2.0:1775764758.353065:0:8398:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000100:00100000:3.0:1775764758.354455:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.354500:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076023040 00000100:00100000:3.0:1775764758.354511:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076023040 00000100:00100000:3.0:1775764758.354563:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6285 00000100:00100000:3.0:1775764758.354572:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+15:44976:x1862023076023040:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1775764758.354660:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.354677:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.354689:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764758.354879:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003c74f2ca reply state 000000003520cf4f transno 4294970508 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.354893:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.354901:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:3.0:1775764758.354910:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1775764758.354914:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1775764758.355016:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+17:44976:x1862023076023040:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 431us (556us total) trans 4294970508 rc 0/0 00000100:00100000:3.0:1775764758.355025:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6285 00000001:00100000:2.0:1775764758.355105:0:7436:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000100:00100000:1.0:1775764758.359021:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.359276:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076023168 00000100:00100000:2.0:1775764758.359287:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076023168 00000100:00100000:2.0:1775764758.359359:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6286 00000100:00100000:2.0:1775764758.359373:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+17:44976:x1862023076023168:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764758.359505:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764758.359530:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 2/0,0 mode: --/CR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f74 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.359591:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 18 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.359607:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 18 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.359618:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:2.0:1775764758.359620:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764758.359624:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1200, rc 0) 00000100:00100000:2.0:1775764758.359684:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+18:44976:x1862023076023168:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 315us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.359691:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6286 00000100:00100000:3.0:1775764758.363047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.363206:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076023296 00000100:00100000:1.0:1775764758.363215:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076023296 00000100:00100000:1.0:1775764758.363274:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1314 00000100:00100000:1.0:1775764758.363291:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+18:44976:x1862023076023296:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1775764758.363423:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+18:44976:x1862023076023296:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.363430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1314 00010000:00010000:2.0:1775764758.385996:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764758.388505:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.388765:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076023552 00000100:00100000:2.0:1775764758.388792:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076023552 00000100:00100000:2.0:1775764758.388851:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1315 00000100:00100000:2.0:1775764758.388870:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+18:44976:x1862023076023552:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764758.389123:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076023552:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 254us (627us total) trans 4294970509 rc 0/0 00000100:00100000:2.0:1775764758.389131:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1315 00000100:00100000:2.0:1775764758.407870:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764758.414697:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076023808 00000100:00100000:0.0:1775764758.414713:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076023808 00000100:00100000:0.0:1775764758.414805:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6287 00000100:00100000:0.0:1775764758.414815:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076023808:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764758.414938:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076023808:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 123us (7077us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764758.414946:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6287 00000100:00100000:3.0:1775764758.419285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764758.419633:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076024064 00000100:00100000:0.0:1775764758.419644:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076024064 00000100:00100000:0.0:1775764758.419702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6288 00000100:00100000:0.0:1775764758.419712:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076024064:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764758.419733:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764758.419753:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c19 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f7b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.419884:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.419900:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 2/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.419908:0:6523:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 4/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.419956:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.419969:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 20 pid: 14288 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.419985:0:6523:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3770a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1862023099772416:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764758.420111:0:6523:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d133ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1775764758.428635:0:6523:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3770a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1862023099772416:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764758.428664:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.433574:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.433832:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076024192 00000100:00100000:1.0:1775764758.433844:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076024192 00010000:00010000:1.0:1775764758.433884:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 21 pid: 14288 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.433916:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1354 00000100:00100000:1.0:1775764758.433925:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:2410:x1862023076024192:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764758.433939:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764758.433946:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 21 pid: 14288 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.433960:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 21 pid: 14288 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.433984:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522c12 lrc: 0/0,0 mode: --/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f74 expref: 21 pid: 14288 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.433999:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:1.0:1775764758.434017:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.434029:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.434043:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 4/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.434081:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764758.434146:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:2410:x1862023076024192:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 222us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.434154:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1354 00010000:00010000:0.0:1775764758.434984:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.434997:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764758.435032:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000406:0x1:0x0]: returning size 0 00000004:00080000:0.0:1775764758.435244:0:6523:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x51:0x0], index 0: 0 00010000:00010000:0.0:1775764758.435379:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435388:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 2/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435396:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435408:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.435413:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435421:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 4/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435435:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:0.0:1775764758.435438:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764758.435453:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 2/0,0 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435460:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522c20 lrc: 0/0,0 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435807:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c19 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f7b expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435817:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764758.435819:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1775764758.435823:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c19 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f7b expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.435833:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1200, rc 0) 00000100:00100000:0.0:1775764758.435894:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076024064:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 16184us (16620us total) trans 4294970510 rc 301/301 00000100:00100000:0.0:1775764758.435902:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6288 00000100:00100000:0.0:1775764758.444530:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.444584:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076024448 00000100:00100000:2.0:1775764758.444596:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076024448 00000100:00100000:2.0:1775764758.444654:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1316 00000100:00100000:2.0:1775764758.444663:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076024448:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764758.444992:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:44976:x1862023076024448:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 330us (472us total) trans 4294970511 rc 0/0 00000100:00100000:2.0:1775764758.444999:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1316 00000100:00100000:3.0:1775764758.450851:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764758.451023:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076024576 00000100:00100000:0.0:1775764758.451035:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076024576 00000100:00100000:0.0:1775764758.451112:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6289 00000100:00100000:0.0:1775764758.451124:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:44976:x1862023076024576:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764758.451155:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764758.451178:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0a00/0x6e98bd47ed522c2e lrc: 2/0,0 mode: --/CR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f82 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.451250:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c35 lrc: 3/1,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.451263:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c35 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.451275:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c35 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764758.451316:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000406:0x1:0x0]: returning size 0 00000004:00200000:0.0:1775764758.451673:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764758.451700:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c35 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.451731:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0a00/0x6e98bd47ed522c2e lrc: 0/0,0 mode: --/CR res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f82 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.451750:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c35 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f82 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.451758:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:0.0:1775764758.451761:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1775764758.451798:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1400, rc 0) 00000100:00100000:0.0:1775764758.451860:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:44976:x1862023076024576:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 739us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764758.451869:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6289 00000100:00100000:0.0:1775764758.458799:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.458909:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076024704 00000100:00100000:2.0:1775764758.458920:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076024704 00000100:00100000:2.0:1775764758.458985:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1651 00000100:00100000:2.0:1775764758.458995:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2409:x1862023076024704:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764758.459024:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764758.459043:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f89 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764758.459069:0:24969:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1775764758.459086:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764758.459088:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764758.459096:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 6 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.459133:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 6 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.459147:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1000, rc 0) 00000100:00100000:2.0:1775764758.459214:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2409:x1862023076024704:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 220us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.459221:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1651 00000100:00100000:3.0:1775764758.464111:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.467817:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076024960 00000100:00100000:1.0:1775764758.467833:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076024960 00000100:00100000:1.0:1775764758.467901:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6290 00000100:00100000:1.0:1775764758.467910:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:44976:x1862023076024960:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1775764758.468026:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:44976:x1862023076024960:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 117us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.468035:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6290 00000100:00100000:0.0:1775764758.486611:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.486988:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025088 00000100:00100000:2.0:1775764758.486998:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025088 00000100:00100000:2.0:1775764758.487067:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1652 00000100:00100000:2.0:1775764758.487077:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:44976:x1862023076025088:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764758.487095:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764758.487114:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f90 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.487147:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.487156:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764758.487158:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764758.487162:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.487195:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.487224:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 1366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764758.487240:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099772544:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764758.487339:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2f9a1e300 going to sleep for 11 seconds 00000100:00100000:1.0:1775764758.502430:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.502534:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099772544:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764758.502570:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.502597:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0600, rc 0) 00000100:00100000:2.0:1775764758.502665:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:44976:x1862023076025088:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 15589us (16062us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.502675:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1652 00000100:00100000:3.0:1775764758.503257:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025216 00000100:00100000:3.0:1775764758.503266:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025216 00010000:00010000:3.0:1775764758.503306:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 1366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764758.503341:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1355 00000100:00100000:3.0:1775764758.503351:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2411:x1862023076025216:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764758.503364:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764758.503385:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 1366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.503398:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 1366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.503420:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed522c3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f89 expref: 7 pid: 24969 timeout: 1366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.503435:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764758.503451:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764758.503459:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.503469:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.503503:0:25200:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764758.503516:0:25200:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25200:1862023099772672:192.168.202.58@tcp:105: 00000100:00100000:3.0:1775764758.503591:0:25200:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c3f22cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764758.527681:0:25200:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25200:1862023099772672:192.168.202.58@tcp:105: 00010000:00010000:3.0:1775764758.527732:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764758.527837:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076025216:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 24486us (25415us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764758.527848:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1355 00000100:00100000:0.0:1775764758.652417:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.652487:0:8408:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025344 00000100:00100000:1.0:1775764758.652499:0:8408:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025344 00002000:00100000:1.0:1775764758.652554:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x51:0x0] (0->1048575) req@ffff96c1c5597480 x1862023076025344/t0(0) o4->9cbd2dce-6222-4b9d-952e-2776ae7cef01@192.168.202.58@tcp:239/0 lens 488/0 e 0 to 0 dl 1775764769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764758.652566:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c5597480 with x1862023076025344 ext(0->1048575) 00002000:00010000:1.0:1775764758.652572:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c5597480 00000100:00100000:1.0:1775764758.652609:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 418 00000100:00100000:1.0:1775764758.652619:0:8408:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2408:x1862023076025344:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1775764758.709287:0:8408:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2408:x1862023076025344:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 Request processed in 56657us (56869us total) trans 4294967709 rc 0/0 00000100:00100000:2.0:1775764758.709311:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 418 00002000:00100000:2.0:1775764758.709325:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x51:0x0] (0->1048575) req@ffff96c1c5597480 x1862023076025344/t4294967709(0) o4->9cbd2dce-6222-4b9d-952e-2776ae7cef01@192.168.202.58@tcp:239/0 lens 488/448 e 0 to 0 dl 1775764769 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764758.709336:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c5597480 with x1862023076025344 ext(0->1048575) 00002000:00010000:2.0:1775764758.709343:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c5597480 00000100:00100000:0.0:1775764758.714976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.715130:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025472 00000100:00100000:3.0:1775764758.715141:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025472 00000100:00100000:3.0:1775764758.715229:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6291 00000100:00100000:3.0:1775764758.715240:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:44976:x1862023076025472:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1775764758.726499:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970511 is committed 00000004:00080000:3.0:1775764758.726521:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 48 committed 00000001:00080000:3.0:1775764758.726544:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970505 is committed 00000004:00080000:3.0:1775764758.726547:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 47 committed 00000020:00080000:3.0:1775764758.726557:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2ff8f7e40 refcount 2 committed 0 result 0 batchid 116 00000020:00080000:3.0:1775764758.726562:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c301de8600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2ff8f7d80 00000020:00080000:3.0:1775764758.726574:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c301de8c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c2ff97f800 00000020:00080000:3.0:1775764758.726617:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 116 committed batchid 115 00000020:00080000:3.0:1775764758.726681:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 115 00000100:00100000:3.0:1775764758.726838:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076025472:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 Request processed in 11595us (11867us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764758.726849:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6291 00010000:00010000:1.0:1775764758.727107:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.727129:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.727136:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.727142:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764758.727146:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.727154:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.727170:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:1.0:1775764758.727172:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1775764758.727176:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 2/0,0 mode: --/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.727182:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522c0b lrc: 0/0,0 mode: --/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.732068:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764758.732093:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099772800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1775764758.732166:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764758.732237:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099772800 00000100:00100000:0.0:1775764758.732245:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099772800 00000100:00100000:0.0:1775764758.732292:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1775764758.732314:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099772800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1775764758.732340:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:81 count 1 00002000:00010000:0.0:1775764758.732374:0:8402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x51:0x0] initial LVB size: 1048576, mtime: 0x69d8050f, atime: 0x0, ctime: 0x69d8050f, blocks: 0x800 00010000:00010000:0.0:1775764758.732381:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.732397:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764758.732399:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764758.732405:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.732419:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.732446:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.732454:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.732469:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1775764758.732609:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099772800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 309us (442us total) trans 4294967712 rc 0/0 00000100:00100000:0.0:1775764758.732617:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1775764758.732663:0:3664:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967711 gen 2 00000004:00080000:0.0:1775764758.732669:0:3664:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967711 committed transno 4294967711 00000100:00100000:0.0:1775764758.732690:0:3664:0:(client.c:3126:ptlrpc_free_committed()) @@@ stopping search req@ffff96c1c5595880 x1862023099772800/t4294967712(4294967712) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1775764774 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1775764758.732699:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c1c5595880/2, rc 0, transno 4294967712 00000100:00100000:0.0:1775764758.732704:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099772800:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1775764758.736930:0:9476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775764758.736947:0:9476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.736996:0:9476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e0800 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764758.737010:0:9476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.737022:0:9476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.737057:0:9476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.737064:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.737093:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764758.737096:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764758.737097:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764758.741496:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.742602:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025600 00000100:00100000:3.0:1775764758.742617:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025600 00000100:00100000:3.0:1775764758.742675:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1654 00000100:00100000:3.0:1775764758.742685:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2409:x1862023076025600:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1775764758.773133:0:29377:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764758.773144:0:29377:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764758.773197:0:29377:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 144 count 3 00000040:00080000:2.0:1775764758.773204:0:29377:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1775764758.793088:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967709 is committed 00000100:00100000:3.0:1775764758.793343:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2409:x1862023076025600:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 Request processed in 50654us (51851us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764758.793354:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1654 00000100:00100000:3.0:1775764758.814379:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764758.814876:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025856 00000100:00100000:0.0:1775764758.814889:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025856 00000100:00100000:0.0:1775764758.814952:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6292 00000100:00100000:0.0:1775764758.814963:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44976:x1862023076025856:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1775764758.815034:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764758.815069:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c35 lrc: 0/0,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f82 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.815111:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:0.0:1775764758.815117:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764758.815147:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.815159:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.815168:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764758.815307:0:6523:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bce88fe2 reply state 00000000f4096d66 transno 4294970512 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.815319:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.815326:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:0.0:1775764758.815328:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1775764758.815331:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1775764758.815433:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076025856:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 472us (1062us total) trans 4294970512 rc 0/0 00000100:00100000:0.0:1775764758.815441:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6292 00000100:00100000:0.0:1775764758.837201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764758.837245:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076025984 00000100:00100000:0.0:1775764758.837256:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076025984 00000100:00100000:0.0:1775764758.837316:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6293 00000100:00100000:0.0:1775764758.837325:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076025984:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764758.837366:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764758.837386:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 2/0,0 mode: --/CR res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f97 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.837444:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.837459:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.837479:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:0.0:1775764758.837482:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764758.837486:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e0e00, rc 0) 00000100:00100000:0.0:1775764758.837543:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44976:x1862023076025984:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 219us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764758.837549:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6293 00000100:00100000:3.0:1775764758.849276:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.849329:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076026112 00000100:00100000:3.0:1775764758.849341:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076026112 00000100:00100000:3.0:1775764758.849396:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1655 00000100:00100000:3.0:1775764758.849405:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076026112:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1775764758.849561:0:8403:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1775764758.849565:0:8403:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb mtime from disk: 0 -> 1775764751 00002000:00010000:3.0:1775764758.849568:0:8403:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb atime from disk: 0 -> 1775764751 00002000:00010000:3.0:1775764758.849570:0:8403:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb ctime from disk: 0 -> 1775764751 00002000:00010000:3.0:1775764758.849572:0:8403:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x51:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:3.0:1775764758.849631:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2411:x1862023076026112:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 Request processed in 227us (366us total) trans 4294967710 rc 0/0 00000100:00100000:3.0:1775764758.849650:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1655 00000100:00100000:0.0:1775764758.855890:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.856307:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076026368 00000100:00100000:3.0:1775764758.856318:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076026368 00000100:00100000:3.0:1775764758.856380:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6294 00000100:00100000:3.0:1775764758.856390:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44976:x1862023076026368:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1775764758.856455:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.856473:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 2/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.856483:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 4/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.856521:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.856535:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 4/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 13 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764758.856550:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099772928:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764758.856647:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c11cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764758.865542:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.868352:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099772928:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764758.868380:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.874552:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076026496 00000100:00100000:1.0:1775764758.874565:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076026496 00010000:00010000:1.0:1775764758.874612:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 4/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 14 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.874666:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1356 00000100:00100000:1.0:1775764758.874675:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:2410:x1862023076026496:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764758.874703:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764758.874710:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 4/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 14 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874732:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 14 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874806:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c04 lrc: 0/0,0 mode: --/PR res: [0x200000406:0x1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f6d expref: 14 pid: 6521 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874823:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:1.0:1775764758.874828:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874838:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874847:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 4/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874875:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764758.874942:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:2410:x1862023076026496:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 268us (9408us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764758.874950:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1356 00010000:00010000:1.0:1775764758.874980:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.874987:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875043:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875050:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 2/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875057:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875062:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764758.875065:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875073:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 4/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875081:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:1.0:1775764758.875083:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1775764758.875086:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 2/0,0 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.875091:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522c5f lrc: 0/0,0 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.875129:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076026368:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 Request processed in 18740us (19250us total) trans 0 rc -22/-22 00000100:00100000:1.0:1775764758.875151:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6294 00000100:00100000:0.0:1775764758.895172:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.895270:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076026624 00000100:00100000:1.0:1775764758.895282:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076026624 00000100:00100000:1.0:1775764758.895353:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1656 00000100:00100000:1.0:1775764758.895377:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2410:x1862023076026624:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1775764758.895422:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.895442:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.895451:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1775764758.895454:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1775764758.895457:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.895494:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.895509:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 7 pid: 8641 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.895523:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099773056:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764758.895608:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b02600 going to sleep for 11 seconds 00000100:00100000:0.0:1775764758.900501:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099773056:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764758.900531:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764758.916960:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.917427:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076026752 00000100:00100000:2.0:1775764758.917437:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076026752 00010000:00010000:2.0:1775764758.917487:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 8 pid: 8641 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764758.917532:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1357 00000100:00100000:2.0:1775764758.917539:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2410:x1862023076026752:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764758.917551:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764758.917569:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 8 pid: 8641 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.917579:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 8 pid: 8641 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.917600:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed522c43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f90 expref: 8 pid: 8641 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.917615:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764758.917616:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764758.917620:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.917627:0:25199:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.917655:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764758.917705:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2410:x1862023076026752:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 165us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.917713:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1357 00010000:00010000:0.0:1775764758.918480:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918492:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918522:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918529:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918536:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918543:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764758.918547:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918556:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918568:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.918575:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bb62916/0x6e98bd47ed522c66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.918634:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2410:x1862023076026624:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 23258us (23474us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764758.918650:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1656 00000100:00100000:0.0:1775764758.928059:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764758.928233:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076027008 00000100:00100000:3.0:1775764758.928251:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076027008 00000100:00100000:3.0:1775764758.928318:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6295 00000100:00100000:3.0:1775764758.928328:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44976:x1862023076027008:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764758.928406:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928423:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928435:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928583:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928594:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 2/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928603:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 4/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928652:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.928666:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 13 pid: 6522 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764758.928680:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099773184:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764758.928752:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2f732c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764758.936226:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099773184:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764758.936260:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.939560:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764758.939648:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076027136 00000100:00100000:2.0:1775764758.939666:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076027136 00010000:00010000:2.0:1775764758.939706:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 14 pid: 6522 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764758.939786:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1358 00000100:00100000:2.0:1775764758.939798:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:2411:x1862023076027136:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764758.939814:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764758.939821:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 14 pid: 6522 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.939834:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 14 pid: 6522 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.939857:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522c58 lrc: 0/0,0 mode: --/CR res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f97 expref: 14 pid: 6522 timeout: 1366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.939874:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:2.0:1775764758.939880:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.939889:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.939897:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 4/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764758.939927:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764758.939979:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:2411:x1862023076027136:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 184us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.939995:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1358 00010000:00010000:3.0:1775764758.940188:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764758.940202:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1775764758.940303:0:10088:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970513 00000001:00080000:3.0:1775764758.940413:0:10088:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970514 00000001:00080000:3.0:1775764758.940449:0:10088:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970515 00000100:00100000:3.0:1775764758.940527:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10088:1862023099773312:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1775764758.940591:0:10088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764758.940626:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c5655a80 going to sleep for 11 seconds 00000100:00100000:2.0:1775764758.940656:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099773312 00000100:00100000:2.0:1775764758.940662:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099773312 00000100:00100000:2.0:1775764758.940710:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1775764758.940718:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10088:x1862023099773312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1775764758.940826:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10088:x1862023099773312:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764758.940833:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1775764758.940914:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10088:1862023099773312:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1775764758.941038:0:10088:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970516 00000100:00100000:0.0:1775764758.941101:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10088:1862023099773440:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1775764758.941147:0:10088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764758.941169:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c11cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764758.941188:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099773440 00000100:00100000:2.0:1775764758.941193:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099773440 00000100:00100000:2.0:1775764758.941230:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00080000:3.0:1775764758.941235:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764758.941241:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10088:x1862023099773440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1775764758.941469:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10088:x1862023099773440:12345-0@lo:1000:mdt00_003.0 Request processed in 232us (321us total) trans 4294967711 rc 0/0 00000100:00100000:2.0:1775764758.941476:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1775764758.941520:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10088:1862023099773440:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1775764758.941573:0:10088:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970517 00010000:00010000:0.0:1775764758.941607:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941616:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 2/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941623:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941629:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.941650:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941658:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 4/0,0 mode: EX/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941684:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:0.0:1775764758.941687:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764758.941693:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 2/0,0 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941698:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522c74 lrc: 0/0,0 mode: --/EX res: [0x200000406:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941726:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941731:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941736:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941741:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.941743:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941748:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941755:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:0.0:1775764758.941794:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764758.941797:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941803:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522b8d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941839:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941850:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941860:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941867:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941873:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941878:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941882:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.941885:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941891:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941899:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:0.0:1775764758.941901:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764758.941903:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941909:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1400/0x6e98bd47ed522c7b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941927:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941932:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941937:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941942:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764758.941945:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941950:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941958:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:0.0:1775764758.941960:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764758.941963:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764758.941969:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522c6d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764758.942105:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+17:44976:x1862023076027008:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 13777us (14055us total) trans 4294970518 rc 0/0 00000100:00100000:0.0:1775764758.942114:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6295 00000020:00080000:0.0:1775764758.942118:0:10088:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:3.0:1775764758.942546:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764758.942551:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764758.943080:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1775764758.943091:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764758.951819:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764758.951906:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076027392 00000100:00100000:1.0:1775764758.951917:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076027392 00000100:00100000:1.0:1775764758.951977:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1317 00000100:00100000:1.0:1775764758.951988:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+17:44976:x1862023076027392:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1775764758.952352:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000406:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1775764758.952400:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970519 00010000:00010000:1.0:1775764758.952434:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 3/0,1 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952451:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952462:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952470:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 4/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952476:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 4/0,1 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952481:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952499:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1775764758.952688:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44976:x1862023076027392:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 645us (820us total) trans 4294970520 rc 0/0 00000100:00100000:1.0:1775764758.952697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1317 00000020:00080000:1.0:1775764758.952702:0:6524:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1775764758.952725:0:9477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775764758.952730:0:9477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 2/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952738:0:9477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764758.952742:0:9477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 2/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952758:0:9477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952793:0:9477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:1.0:1775764758.952796:0:9477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1775764758.952801:0:9477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 1/0,0 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952807:0:9477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522c82 lrc: 0/0,0 mode: --/PW res: [0x200000406:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764758.952819:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764758.952821:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764758.952822:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764759.410354:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764760.376663:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099773568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764760.376830:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764760.376975:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099773568 00000100:00100000:1.0:1775764760.376984:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099773568 00000100:00100000:1.0:1775764760.377064:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1775764760.377084:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099773568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764760.377123:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 9109504 pending 0 free 1444249600 avail 1298010112 00000100:00100000:1.0:1775764760.417131:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099773568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40046us (40289us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764760.417148:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1775764760.419559:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099773568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1775764760.436469:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764761.395681:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099773696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764761.395804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764761.395886:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099773696 00000100:00100000:1.0:1775764761.395895:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099773696 00000100:00100000:1.0:1775764761.395958:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:1.0:1775764761.395967:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099773696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764761.396032:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509154368 pending 0 free 3915911168 avail 3684388864 00000100:00100000:1.0:1775764761.396094:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099773696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764761.396101:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00080000:1.0:1775764761.396122:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764761.396159:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099773696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764761.398448:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099773824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764761.398517:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764761.398636:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099773824 00000100:00100000:0.0:1775764761.398644:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099773824 00000100:00100000:0.0:1775764761.398718:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1775764761.398727:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099773824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764761.398750:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509154368 pending 0 free 3915911168 avail 3684388864 00000100:00100000:0.0:1775764761.398813:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099773824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764761.398821:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00080000:1.0:1775764761.398947:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764761.399013:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099773824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1775764761.470200:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764761.527532:0:29428:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764761.527540:0:29428:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764761.527591:0:29428:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 144 count 3 00000040:00080000:0.0:1775764761.527599:0:29428:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764761.709186:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764761.712243:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076027520 00000100:00100000:0.0:1775764761.712260:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076027520 00000100:00100000:0.0:1775764761.712346:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6296 00000100:00100000:0.0:1775764761.712357:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:44985:x1862023076027520:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764761.712381:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764761.712405:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522c89 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4f9e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712491:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712510:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712524:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712603:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712612:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712619:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712745:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712754:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712760:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764761.712838:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00000004:00200000:0.0:1775764761.712843:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764761.712866:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712879:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712888:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712895:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712912:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712918:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764761.712923:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712931:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712943:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764761.712947:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764761.712952:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712959:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522c90 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712985:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712990:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.712996:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713001:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764761.713003:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713020:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713028:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x1a471d3 (ffff96c2d572af00) 00010000:00010000:0.0:1775764761.713030:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764761.713033:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713038:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522c97 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713073:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1600/0x6e98bd47ed522c89 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 21 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713090:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.713097:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a800) 00010000:00010000:0.0:1775764761.713100:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764761.713102:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1200, rc 0) 00000100:00100000:0.0:1775764761.713208:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:44985:x1862023076027520:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 852us (4036us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764761.713216:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6296 00000100:00080000:1.0:1775764761.713302:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764761.721424:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764761.721916:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076027648 00000100:00100000:3.0:1775764761.721927:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076027648 00000100:00100000:3.0:1775764761.722004:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1657 00000100:00100000:3.0:1775764761.722014:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076027648:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764761.722031:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764761.722053:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fa5 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764761.722076:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x51:0x0] initial LVB size: 1048576, mtime: 0x69d8050f, atime: 0x69d8050f, ctime: 0x69d8050f, blocks: 0x800 00010000:00010000:3.0:1775764761.722095:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764761.722098:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764761.722116:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.722134:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.722150:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764761.722206:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076027648:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 193us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764761.722212:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1657 00000100:00080000:1.0:1775764761.722414:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764761.750330:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764761.750373:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076027776 00000100:00100000:3.0:1775764761.750383:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076027776 00000100:00100000:3.0:1775764761.750438:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6297 00000100:00100000:3.0:1775764761.750449:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:44985:x1862023076027776:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764761.750472:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764761.750493:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fac expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.750565:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.750581:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.750593:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764761.750639:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1775764761.750657:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764761.750682:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.750709:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.750740:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 21 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.750749:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:3.0:1775764761.750752:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764761.750756:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764761.750837:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:44985:x1862023076027776:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 390us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764761.750844:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6297 00000100:00100000:1.0:1775764761.793458:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764761.801396:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076028032 00000100:00100000:3.0:1775764761.801411:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076028032 00000100:00100000:3.0:1775764761.801475:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6298 00000100:00100000:3.0:1775764761.801486:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:44985:x1862023076028032:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764761.801508:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764761.801528:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522cba lrc: 2/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fb3 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.801655:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cc1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.801850:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.801877:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764761.801891:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:3.0:1775764761.802179:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522cba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fb3 expref: 24 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.802199:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fb3 expref: 23 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.802209:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a800) 00010000:00010000:3.0:1775764761.802213:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1775764761.802216:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764761.802288:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:44985:x1862023076028032:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 804us (8841us total) trans 4294970521 rc 0/0 00000100:00100000:3.0:1775764761.802297:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6298 00000100:00100000:1.0:1775764761.811614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764761.811865:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076028160 00000100:00100000:2.0:1775764761.811876:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076028160 00000100:00100000:2.0:1775764761.811941:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1658 00000100:00100000:2.0:1775764761.811951:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076028160:12345-192.168.202.58@tcp:1:lfs.0 00010000:00010000:2.0:1775764761.812021:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764761.812045:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764761.812075:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764761.812078:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764761.812082:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764761.812129:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764761.812145:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 7 pid: 15167 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764761.812162:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099773952:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764761.812252:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2f9a1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1775764761.832029:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099773952:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764761.832070:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764761.851319:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764761.851503:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076028288 00000100:00100000:3.0:1775764761.851515:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076028288 00010000:00010000:3.0:1775764761.851560:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 8 pid: 15167 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764761.851661:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1359 00000100:00100000:3.0:1775764761.851670:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076028288:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764761.851692:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764761.851715:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 8 pid: 15167 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.851768:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 8 pid: 15167 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.851984:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522ca5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fa5 expref: 8 pid: 15167 timeout: 1369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.852000:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764761.852002:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764761.852007:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.852017:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.852068:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764761.852121:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764761.852128:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076028288:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 459us (817us total) trans 0 rc 0/0 00010000:00010000:0.0:1775764761.852132:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764761.852136:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1359 00010000:00010000:0.0:1775764761.852162:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.852169:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.852178:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.852190:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764761.852199:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.852209:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.852221:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.852228:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed522ccf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764761.852295:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076028160:12345-192.168.202.58@tcp:1:lfs.0 Request processed in 40345us (40691us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764761.852303:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1658 00000100:00100000:3.0:1775764761.862484:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764761.862540:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076028544 00000100:00100000:1.0:1775764761.862553:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076028544 00000100:00100000:1.0:1775764761.862621:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1318 00000100:00100000:1.0:1775764761.862631:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dd67d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:44985:x1862023076028544:12345-192.168.202.58@tcp:35:lfs.0 00000004:00010000:1.0:1775764761.862710:0:6525:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x200000403:0x97:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fb3 expref: 23 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1775764761.862986:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970522 00000001:00080000:1.0:1775764761.863305:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970523 00010000:00010000:1.0:1775764761.863342:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.863370:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 26 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.863379:0:6525:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.863420:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 26 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.863435:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 26 pid: 14288 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764761.863451:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099774080:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764761.863547:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b02300 going to sleep for 11 seconds 00000100:00100000:3.0:1775764761.871156:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764761.874493:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099774080:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764761.874525:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764761.878324:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076028672 00000100:00100000:0.0:1775764761.878344:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076028672 00010000:00010000:0.0:1775764761.878410:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 27 pid: 14288 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764761.878467:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1360 00000100:00100000:0.0:1775764761.878477:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+27:2411:x1862023076028672:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764761.878492:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764761.878499:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 27 pid: 14288 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.878515:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 27 pid: 14288 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.878538:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522c9e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f9e expref: 27 pid: 14288 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.878566:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a800) 00010000:00010000:0.0:1775764761.878572:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.878582:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.878590:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.878632:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764761.878706:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:2411:x1862023076028672:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 231us (7563us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764761.878729:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1360 00010000:00010000:3.0:1775764761.880518:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.880533:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1775764761.880666:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970524 00000001:00080000:3.0:1775764761.881549:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970525 00000100:00100000:3.0:1775764761.881666:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35df100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099774208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1775764761.884178:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764761.884262:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c635da80 going to sleep for 11 seconds 00000100:00100000:2.0:1775764761.889040:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099774208 00000100:00100000:2.0:1775764761.889056:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099774208 00000100:00100000:2.0:1775764761.889265:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1775764761.889286:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1862023099774208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1775764761.889439:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1862023099774208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 155us (5268us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764761.889447:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1775764761.889615:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35df100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099774208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1775764761.889850:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970526 00000100:00100000:0.0:1775764761.889931:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d53100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099774336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764761.889984:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764761.895792:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d133ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1775764761.896560:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099774336 00000100:00100000:3.0:1775764761.896574:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099774336 00000100:00100000:3.0:1775764761.896642:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1775764761.896652:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1862023099774336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1775764761.900963:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1862023099774336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 4301us (10967us total) trans 4294967712 rc 0/0 00000100:00100000:3.0:1775764761.900990:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1775764761.901090:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d53100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099774336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1775764761.901179:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970527 00010000:00010000:3.0:1775764761.901228:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.901237:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.901244:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.901250:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764761.901255:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.901263:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.902179:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a800) 00010000:00010000:3.0:1775764761.902193:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1775764761.902199:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.902206:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed522cd6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1775764761.902430:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000405:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1775764761.902518:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].65, 64 off13192 00000004:00080000:3.0:1775764761.902529:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1269723757596ns, next at 1270723755751ns, rc = 0 00000001:00080000:3.0:1775764761.902536:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970528 00010000:00010000:3.0:1775764761.902565:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a800) 00010000:00010000:3.0:1775764761.902568:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1775764761.902574:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522cc1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fb3 expref: 30 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764761.902701:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dd67d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+29:44985:x1862023076028544:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 40071us (40228us total) trans 4294970529 rc 0/0 00000100:00100000:3.0:1775764761.902710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1318 00000020:00080000:3.0:1775764761.902715:0:6525:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1775764761.931308:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764761.931396:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076028928 00000100:00100000:0.0:1775764761.931408:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076028928 00000100:00100000:0.0:1775764761.931484:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6299 00000100:00100000:0.0:1775764761.931494:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+42:44986:x1862023076028928:12345-192.168.202.58@tcp:101:dd.0 00010000:00010000:0.0:1775764761.931517:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764761.931539:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522cdd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fba expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931623:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931640:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931651:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931667:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931674:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931699:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931856:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522cf2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931865:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931871:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764761.931883:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:0.0:1775764761.931911:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931918:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931924:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931929:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764761.931933:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931940:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931952:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764761.931954:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764761.931965:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931981:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522ce4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.931997:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932002:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932008:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932013:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764761.932016:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932021:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932029:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x1a471d3 (ffff96c2d572af00) 00010000:00010000:0.0:1775764761.932032:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764761.932034:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932040:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0600/0x6e98bd47ed522ceb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932084:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1200/0x6e98bd47ed522cdd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fba expref: 44 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932112:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fba expref: 43 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764761.932120:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a500) 00010000:00010000:0.0:1775764761.932122:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764761.932124:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1e00, rc 0) 00000100:00100000:0.0:1775764761.932195:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076028928:12345-192.168.202.58@tcp:101:dd.0 Request processed in 703us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764761.932204:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6299 00000100:00080000:3.0:1775764761.933112:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764761.956522:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764761.958236:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076029184 00000100:00100000:3.0:1775764761.958251:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076029184 00000100:00100000:3.0:1775764761.958333:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 732 00000100:00100000:3.0:1775764761.958345:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076029184:12345-192.168.202.58@tcp:103:dd.0 00010000:00010000:3.0:1775764761.958362:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764761.958391:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1e00/0x6e98bd47ed522cf2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fba expref: 43 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.958429:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c2d572a500) 00010000:00010000:3.0:1775764761.958442:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764761.958507:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+42:44986:x1862023076029184:12345-192.168.202.58@tcp:103:dd.0 Request processed in 165us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764761.958515:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 732 00000100:00100000:1.0:1775764761.979468:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764761.979900:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076029312 00000100:00100000:3.0:1775764761.979914:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076029312 00000100:00100000:3.0:1775764761.979999:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6300 00000100:00100000:3.0:1775764761.980011:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+42:44986:x1862023076029312:12345-192.168.202.58@tcp:58:dd.0 00010000:00010000:3.0:1775764761.980139:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.980158:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764761.980171:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1775764761.980310:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].144, 136 off27568 00000100:00100000:3.0:1775764761.980438:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+42:44986:x1862023076029312:12345-192.168.202.58@tcp:58:dd.0 Request processed in 428us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764761.980446:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6300 00000100:00100000:3.0:1775764761.990443:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764761.990657:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076029440 00000100:00100000:1.0:1775764761.990668:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076029440 00000100:00100000:1.0:1775764761.990742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6301 00000100:00100000:1.0:1775764761.990752:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+42:44986:x1862023076029440:12345-192.168.202.58@tcp:101:dd.0 00010000:00010000:1.0:1775764761.990799:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764761.990823:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fc1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.990879:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.990890:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.990921:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.990936:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.990951:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:1.0:1775764761.990954:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1775764761.990968:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764761.990984:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0600, rc 0) 00000100:00100000:1.0:1775764761.991064:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076029440:12345-192.168.202.58@tcp:101:dd.0 Request processed in 312us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764761.991071:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6301 00000040:00080000:2.0:1775764762.037856:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764762.037865:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764762.037892:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 145 count 4 00000040:00080000:2.0:1775764762.037900:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764762.038064:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e40000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099774464:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764762.038161:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c24546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764762.050395:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e40000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099774464:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1775764762.055572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.055949:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076029568 00000100:00100000:3.0:1775764762.055977:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076029568 00000100:00100000:3.0:1775764762.056056:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6302 00000100:00100000:3.0:1775764762.056067:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44987:x1862023076029568:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764762.056120:0:6523:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x97:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764762.056234:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44987:x1862023076029568:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 169us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.056243:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6302 00000100:00080000:0.0:1775764762.056511:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764762.067903:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764762.068139:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076029696 00000100:00100000:2.0:1775764762.068150:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076029696 00000100:00100000:2.0:1775764762.068210:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6303 00000100:00100000:2.0:1775764762.068220:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44987:x1862023076029696:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1775764762.068302:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068320:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068332:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068348:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068354:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068375:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068399:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068407:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068414:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764762.068458:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00000004:00200000:2.0:1775764762.068463:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764762.068476:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068486:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068491:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068497:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068503:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.068507:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068514:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068531:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764762.068534:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.068538:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068544:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522d0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068556:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068561:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068567:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068572:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.068574:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068579:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068585:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xefb1cfac (ffff96c1c4135300) 00010000:00010000:2.0:1775764762.068587:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.068590:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068595:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefb1cfac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068619:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068625:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068630:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068634:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.068637:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068642:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068649:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:2.0:1775764762.068651:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.068653:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.068659:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764762.072268:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44987:x1862023076029696:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 Request processed in 4038us (4363us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764762.072284:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6303 00000100:00100000:1.0:1775764762.078455:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.078633:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076029952 00000100:00100000:3.0:1775764762.078645:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076029952 00000100:00100000:3.0:1775764762.078709:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6304 00000100:00100000:3.0:1775764762.078719:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44987:x1862023076029952:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764762.078741:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764762.078795:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522d23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fc8 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.078905:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.078920:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.078932:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764762.078943:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00010000:00010000:2.0:1775764762.092347:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092382:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092389:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092395:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.092399:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092407:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092423:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:2.0:1775764762.092426:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764762.092430:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 2/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092435:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522d2a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092488:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522d23 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc8 expref: 21 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092499:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764762.092501:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764762.092505:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed522d23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc8 expref: 21 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.092513:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:2.0:1775764762.096297:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:44987:x1862023076029952:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 17564us (17837us total) trans 4294970530 rc 301/301 00000100:00100000:2.0:1775764762.096313:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6304 00000100:00100000:1.0:1775764762.110321:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.110397:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076030080 00000100:00100000:3.0:1775764762.110409:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076030080 00000100:00100000:3.0:1775764762.110470:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6305 00000100:00100000:3.0:1775764762.110479:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:44987:x1862023076030080:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764762.110517:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x97:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764762.110635:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:44987:x1862023076030080:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 156us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.110656:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6305 00000100:00100000:1.0:1775764762.115869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.116045:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076030336 00000100:00100000:0.0:1775764762.116057:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076030336 00000100:00100000:0.0:1775764762.116125:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6306 00000100:00100000:0.0:1775764762.116137:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+20:44987:x1862023076030336:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764762.116163:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764762.116185:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522d38 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fcf expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.116651:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522d3f lrc: 3/1,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.116666:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522d3f lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.116677:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522d3f lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764762.116703:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000406:0x2:0x0]: returning size 0 00010000:00010000:0.0:1775764762.116747:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522d38 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fcf expref: 23 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.116766:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522d3f lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fcf expref: 22 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.116809:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c2d572af00) 00010000:00010000:0.0:1775764762.116812:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764762.116816:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e0e00, rc 0) 00000100:00100000:0.0:1775764762.116882:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+22:44987:x1862023076030336:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 748us (1021us total) trans 4294970531 rc 0/0 00000100:00100000:0.0:1775764762.116890:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6306 00000100:00100000:1.0:1775764762.132395:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764762.132805:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076030592 00000100:00100000:2.0:1775764762.132816:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076030592 00000100:00100000:2.0:1775764762.132865:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6307 00000100:00100000:2.0:1775764762.132874:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+22:44987:x1862023076030592:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1775764762.132934:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764762.132979:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0e00/0x6e98bd47ed522d3f lrc: 0/0,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fcf expref: 22 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.133000:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c2d572af00) 00010000:00010000:2.0:1775764762.133010:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764762.133034:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.133046:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 28 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.133063:0:14288:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 4/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.133099:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 28 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.133113:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 28 pid: 10681 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764762.133150:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e40000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099774592:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764762.133246:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c24546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764762.141392:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e40000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099774592:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764762.141439:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.143358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.143585:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076030720 00000100:00100000:0.0:1775764762.143599:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076030720 00010000:00010000:0.0:1775764762.143645:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 29 pid: 10681 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764762.143689:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1361 00000100:00100000:0.0:1775764762.143699:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+29:2411:x1862023076030720:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764762.143715:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764762.143732:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 29 pid: 10681 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.143755:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 29 pid: 10681 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.143849:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522cb3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fac expref: 29 pid: 10681 timeout: 1369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.143871:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764762.143877:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.143886:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.143893:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.144093:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764762.144203:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:2411:x1862023076030720:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 504us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.144212:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1361 00010000:00010000:2.0:1775764762.144381:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144390:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144446:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144456:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144464:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144509:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144515:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144522:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144538:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.144542:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144550:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144558:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:2.0:1775764762.144561:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.144564:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 2/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144570:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed522d4d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144579:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144585:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144590:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144595:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.144598:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144603:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144617:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0xa249a6c0 (ffff96c1c4135300) 00010000:00010000:2.0:1775764762.144619:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.144621:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 2/0,0 mode: --/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.144627:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522d54 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x5:0x0].0xa249a6c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764762.144692:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:44987:x1862023076030592:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 11813us (12303us total) trans 0 rc -2/-2 00000100:00100000:2.0:1775764762.144699:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6307 00000100:00100000:1.0:1775764762.152521:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764762.152606:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076030848 00000100:00100000:2.0:1775764762.152625:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076030848 00000100:00100000:2.0:1775764762.152692:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6308 00000100:00100000:2.0:1775764762.152703:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+21:44987:x1862023076030848:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764762.152728:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764762.152754:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522d5b lrc: 2/0,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fd6 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.152821:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 3/1,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.152838:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.152851:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.153227:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522d5b lrc: 0/0,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 23 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.153255:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.153263:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:2.0:1775764762.153266:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764762.153269:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1800, rc 0) 00000100:00100000:2.0:1775764762.153324:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+22:44987:x1862023076030848:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 623us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764762.153332:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6308 00000100:00100000:2.0:1775764762.167570:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.167669:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076031104 00000100:00100000:0.0:1775764762.167680:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076031104 00000100:00100000:0.0:1775764762.167820:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6309 00000100:00100000:0.0:1775764762.167832:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+22:44987:x1862023076031104:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1775764762.170726:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.170820:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.170837:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764762.171032:0:6523:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000057d89e5b reply state 000000005ac6c229 transno 4294970532 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.171046:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.171055:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.171058:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1775764762.171064:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764762.171200:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+24:44987:x1862023076031104:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 3365us (3639us total) trans 4294970532 rc 0/0 00000100:00100000:1.0:1775764762.171210:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6309 00000100:00100000:1.0:1775764762.180190:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.180423:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076031232 00000100:00100000:3.0:1775764762.180435:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076031232 00000100:00100000:3.0:1775764762.180500:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6310 00000100:00100000:3.0:1775764762.180511:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+24:44987:x1862023076031232:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764762.180537:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764762.180557:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 2/0,0 mode: --/CR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fdd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.180615:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.180633:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.180643:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:3.0:1775764762.180645:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1775764762.180649:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8800, rc 0) 00000100:00100000:3.0:1775764762.180719:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+25:44987:x1862023076031232:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 209us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.180726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6310 00000100:00100000:0.0:1775764762.191767:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.191999:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076031360 00000100:00100000:3.0:1775764762.192012:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076031360 00000100:00100000:3.0:1775764762.192077:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1319 00000100:00100000:3.0:1775764762.192089:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+25:44987:x1862023076031360:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1775764762.192242:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+25:44987:x1862023076031360:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 Request processed in 155us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.192264:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1319 00000100:00100000:2.0:1775764762.200116:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.211879:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076031616 00000100:00100000:3.0:1775764762.211895:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076031616 00000100:00100000:3.0:1775764762.215035:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1320 00000100:00100000:3.0:1775764762.215059:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+25:44987:x1862023076031616:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764762.215344:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+26:44987:x1862023076031616:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 296us (15238us total) trans 4294970533 rc 0/0 00000100:00100000:3.0:1775764762.215353:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1320 00000100:00100000:2.0:1775764762.220076:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.220350:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076031872 00000100:00100000:0.0:1775764762.220360:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076031872 00000100:00100000:0.0:1775764762.220454:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6311 00000100:00100000:0.0:1775764762.220465:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+26:44987:x1862023076031872:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764762.220591:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+26:44987:x1862023076031872:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 128us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.220599:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6311 00000100:00100000:0.0:1775764762.223016:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.223124:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076032128 00000100:00100000:3.0:1775764762.223133:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076032128 00000100:00100000:3.0:1775764762.223478:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6312 00000100:00100000:3.0:1775764762.223490:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+26:44987:x1862023076032128:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764762.223510:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764762.223534:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522d77 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4fe4 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.223668:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.223967:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 2/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.223989:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 4/0,1 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.224026:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.224050:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 27 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.224066:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099774720:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764762.224175:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c635d780 going to sleep for 11 seconds 00000100:00100000:3.0:1775764762.231266:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099774720:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764762.231461:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.231945:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076032256 00000100:00100000:1.0:1775764762.231955:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076032256 00010000:00010000:1.0:1775764762.232006:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 28 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.232051:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1362 00000100:00100000:1.0:1775764762.232061:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+28:2411:x1862023076032256:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764762.232077:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764762.232084:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 28 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.232127:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 28 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.232153:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522d70 lrc: 0/0,0 mode: --/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fdd expref: 28 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.232171:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.232176:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.232187:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.232195:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 4/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.232215:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764762.232433:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+27:2411:x1862023076032256:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 372us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.232442:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1362 00010000:00010000:3.0:1775764762.232586:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.232597:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.232603:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764762.232625:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000406:0x2:0x0]: returning size 0 00000004:00080000:1.0:1775764762.234215:0:24980:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x52:0x0], index 1: 0 00010000:00010000:1.0:1775764762.234333:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234343:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 2/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234350:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234367:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764762.234371:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234378:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 4/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234391:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.234393:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1775764762.234397:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 2/0,0 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234403:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522d7e lrc: 0/0,0 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234454:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522d77 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fe4 expref: 27 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234464:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:1.0:1775764762.234466:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1775764762.234470:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522d77 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fe4 expref: 27 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.234478:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8400, rc 0) 00000100:00100000:1.0:1775764762.234541:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+26:44987:x1862023076032128:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 11053us (11535us total) trans 4294970534 rc 301/301 00000100:00100000:1.0:1775764762.234549:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6312 00000100:00100000:3.0:1775764762.235507:0:9674:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9674:1862023099774848:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1775764762.235559:0:9674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764762.235596:0:9674:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c635d540 going to sleep for 11 seconds 00000100:00100000:0.0:1775764762.235668:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099774848 00000100:00100000:0.0:1775764762.235677:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099774848 00000100:00100000:0.0:1775764762.235747:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1775764762.235766:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9674:x1862023099774848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1775764762.235835:0:8405:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 98 00000100:00100000:0.0:1775764762.237437:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:9674:x1862023099774848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1676us (1871us total) trans 4294967713 rc 0/0 00000100:00100000:0.0:1775764762.237447:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:2.0:1775764762.238349:0:9674:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9674:1862023099774848:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1775764762.238365:0:9674:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x52:0x0]-[0x2c0000401:0x81:0x0] 00000100:00080000:3.0:1775764762.238908:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764762.243437:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.244327:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076032512 00000100:00100000:1.0:1775764762.244359:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076032512 00000100:00100000:1.0:1775764762.244457:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1321 00000100:00100000:1.0:1775764762.244467:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+26:44987:x1862023076032512:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764762.245186:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+27:44987:x1862023076032512:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 718us (1757us total) trans 4294970535 rc 0/0 00000100:00100000:1.0:1775764762.245196:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1321 00000100:00100000:2.0:1775764762.265403:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.265476:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076032640 00000100:00100000:1.0:1775764762.265487:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076032640 00000100:00100000:1.0:1775764762.265548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6313 00000100:00100000:1.0:1775764762.265558:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+27:44987:x1862023076032640:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764762.265583:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764762.265604:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522d8c lrc: 2/0,0 mode: --/CR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4feb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.265685:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522d93 lrc: 3/1,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.265700:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522d93 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.265713:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522d93 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764762.266157:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000406:0x2:0x0]: returning size 0 00000004:00200000:1.0:1775764762.266162:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764762.266184:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522d93 lrc: 3/1,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.266215:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522d8c lrc: 0/0,0 mode: --/CR res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4feb expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.266254:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522d93 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4feb expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.266265:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.266268:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1775764762.266272:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc 0) 00000100:00100000:1.0:1775764762.266354:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+28:44987:x1862023076032640:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 797us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.266363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6313 00000100:00100000:3.0:1775764762.272431:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.272599:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076032768 00000100:00100000:0.0:1775764762.272608:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076032768 00000100:00100000:0.0:1775764762.272692:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1660 00000100:00100000:0.0:1775764762.272703:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2409:x1862023076032768:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764762.272721:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764762.272746:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4ff2 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764762.273118:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1775764762.273142:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764762.273146:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764762.273157:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 6 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.273176:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 6 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.273192:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e0800, rc 0) 00000100:00100000:0.0:1775764762.273342:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2409:x1862023076032768:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 563us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.273352:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1660 00000100:00080000:3.0:1775764762.274386:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764762.281485:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.281599:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033024 00000100:00100000:1.0:1775764762.281619:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033024 00000100:00100000:1.0:1775764762.281738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6314 00000100:00100000:1.0:1775764762.281756:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+28:44987:x1862023076033024:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1775764762.282436:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+28:44987:x1862023076033024:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 687us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.282445:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6314 00000100:00100000:2.0:1775764762.312341:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.312524:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033152 00000100:00100000:3.0:1775764762.312537:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033152 00000100:00100000:3.0:1775764762.312604:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1661 00000100:00100000:3.0:1775764762.312625:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:44987:x1862023076033152:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764762.312663:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764762.312694:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd4ff9 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.312936:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.312948:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764762.312951:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764762.313102:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.313146:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.313161:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.313178:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099774976:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764762.314799:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c635dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764762.323237:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099774976:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764762.323291:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.323317:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9c00, rc 0) 00000100:00100000:2.0:1775764762.323450:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:44987:x1862023076033152:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 10827us (11123us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764762.323479:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1661 00000100:00100000:0.0:1775764762.346008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.353576:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033280 00000100:00100000:1.0:1775764762.353593:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033280 00010000:00010000:1.0:1775764762.353667:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.353814:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1363 00000100:00100000:1.0:1775764762.353825:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2411:x1862023076033280:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764762.353844:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764762.353880:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.353895:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.353919:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2e3f0e/0x6e98bd47ed522d9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff2 expref: 7 pid: 15167 timeout: 1370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.353946:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764762.353948:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764762.354542:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.354556:0:25199:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.354603:0:25199:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.354618:0:25199:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:25199:1862023099775104:192.168.202.58@tcp:105: 00000100:00100000:1.0:1775764762.354703:0:25199:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764762.372323:0:25199:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:25199:1862023099775104:192.168.202.58@tcp:105: 00010000:00010000:1.0:1775764762.372351:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764762.372413:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076033280:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 18588us (26414us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.372444:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1363 00000100:00100000:3.0:1775764762.407193:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.407541:0:16794:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033408 00000100:00100000:0.0:1775764762.407555:0:16794:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033408 00002000:00100000:0.0:1775764762.407624:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x52:0x0] (0->1048575) req@ffff96c2ff822300 x1862023076033408/t0(0) o4->9cbd2dce-6222-4b9d-952e-2776ae7cef01@192.168.202.58@tcp:243/0 lens 488/0 e 0 to 0 dl 1775764773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764762.407636:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2ff822300 with x1862023076033408 ext(0->1048575) 00002000:00010000:0.0:1775764762.407643:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c2ff822300 00000100:00100000:0.0:1775764762.407678:0:16794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 419 00000100:00100000:0.0:1775764762.407687:0:16794:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2408:x1862023076033408:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1775764762.419106:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099775232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764762.419180:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764762.419934:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099775232 00000100:00100000:1.0:1775764762.419944:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099775232 00000100:00100000:1.0:1775764762.420016:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1775764762.420024:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099775232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764762.420061:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446223872 avail 1299984384 00000100:00100000:1.0:1775764762.420122:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099775232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.420129:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1775764762.420178:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099775232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764762.462529:0:16794:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2408:x1862023076033408:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 Request processed in 54829us (55334us total) trans 4294967714 rc 0/0 00000100:00100000:1.0:1775764762.462545:0:16794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 419 00002000:00100000:1.0:1775764762.462560:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x52:0x0] (0->1048575) req@ffff96c2ff822300 x1862023076033408/t4294967714(0) o4->9cbd2dce-6222-4b9d-952e-2776ae7cef01@192.168.202.58@tcp:243/0 lens 488/448 e 0 to 0 dl 1775764773 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764762.462573:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2ff822300 with x1862023076033408 ext(0->1048575) 00002000:00010000:1.0:1775764762.462581:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c2ff822300 00000100:00100000:3.0:1775764762.470088:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.470140:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033536 00000100:00100000:0.0:1775764762.470151:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033536 00000100:00100000:0.0:1775764762.470223:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6315 00000100:00100000:0.0:1775764762.470234:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+28:44987:x1862023076033536:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1775764762.481062:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970535 is committed 00000001:00080000:1.0:1775764762.481101:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970529 is committed 00000004:00080000:1.0:1775764762.481105:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000020:00080000:1.0:1775764762.481130:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2c7e26780 refcount 2 committed 0 result 0 batchid 118 00000020:00080000:1.0:1775764762.481135:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c2ff8d4a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2c7e26240 00000020:00080000:1.0:1775764762.481137:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c2ff8d4400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2daf800 00000020:00080000:1.0:1775764762.481163:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2c5655cc0 refcount 2 committed 0 result 0 batchid 117 00000020:00080000:1.0:1775764762.481179:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c2ff8d4000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2dfee1180 00000020:00080000:1.0:1775764762.481181:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c2ff8d4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2eabc00 00000020:00080000:1.0:1775764762.481193:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 116 batchid updated 00000100:00100000:1.0:1775764762.481354:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44987:x1862023076033536:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 Request processed in 11118us (11273us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.481366:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6315 00000020:00080000:0.0:1775764762.481436:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 118 committed batchid 116 00000020:00080000:0.0:1775764762.481504:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 116 00010000:00010000:1.0:1775764762.481993:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764762.482220:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099775360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1775764762.482285:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1775764762.482366:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482382:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482389:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482395:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.482400:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.482402:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099775360 00010000:00010000:2.0:1775764762.482407:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.482418:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099775360 00010000:00010000:2.0:1775764762.482422:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x1:0x0].0x0 (ffff96c2d0b62000) 00010000:00010000:2.0:1775764762.482425:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.482430:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 2/0,0 mode: --/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482436:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e0400/0x6e98bd47ed522c51 lrc: 0/0,0 mode: --/TXN res: [0x200000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482462:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482469:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482486:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.482487:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00010000:00010000:2.0:1775764762.482491:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.482494:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.482495:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f6793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1862023099775360:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1775764762.482500:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482508:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:2.0:1775764762.482510:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1775764762.482512:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 2/0,0 mode: --/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.482517:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522d69 lrc: 0/0,0 mode: --/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1775764762.482519:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:81 count 1 00002000:00010000:3.0:1775764762.482556:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x51:0x0] initial LVB size: 1048576, mtime: 0x69d8050f, atime: 0x69d8050f, ctime: 0x69d8050f, blocks: 0x800 00010000:00010000:3.0:1775764762.482563:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.482577:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764762.482579:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764762.482585:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.482597:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.482604:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.482611:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.482627:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1775764762.484118:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f6793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3664:x1862023099775360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1618us (1828us total) trans 4294967713 rc 0/0 00000100:00100000:3.0:1775764762.484129:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00010000:00010000:3.0:1775764762.484319:0:6509:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764762.484326:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.484346:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764762.484350:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1775764762.484353:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c2ff820380/2, rc 0, transno 4294967713 00000100:00100000:0.0:1775764762.484359:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099775360:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1775764762.484360:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.484378:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.484385:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522da8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.484406:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764762.484408:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764762.484410:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764762.490161:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764762.490599:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033664 00000100:00100000:2.0:1775764762.490608:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033664 00000100:00100000:2.0:1775764762.490660:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1663 00000100:00100000:2.0:1775764762.490666:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2410:x1862023076033664:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1775764762.495402:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967714 is committed 00000001:00080000:1.0:1775764762.496737:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967713 is committed 00000100:00100000:2.0:1775764762.496964:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2410:x1862023076033664:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 Request processed in 6291us (6811us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764762.496992:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1663 00000100:00100000:2.0:1775764762.511187:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.514303:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076033920 00000100:00100000:1.0:1775764762.514319:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076033920 00000100:00100000:1.0:1775764762.514397:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6316 00000100:00100000:1.0:1775764762.514408:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+11:44987:x1862023076033920:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1775764762.514491:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764762.514521:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522d93 lrc: 0/0,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4feb expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.514671:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.514676:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764762.514708:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.514723:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.514733:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764762.514928:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f8735d61 reply state 000000009969324e transno 4294970536 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.514941:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.514947:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.514949:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764762.515754:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764762.515924:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44987:x1862023076033920:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 1515us (4745us total) trans 4294970536 rc 0/0 00000100:00100000:1.0:1775764762.515933:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6316 00000100:00100000:3.0:1775764762.523065:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.523514:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076034048 00000100:00100000:0.0:1775764762.523526:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076034048 00000100:00100000:0.0:1775764762.523616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6317 00000100:00100000:0.0:1775764762.523627:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44987:x1862023076034048:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764762.523650:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764762.523670:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 2/0,0 mode: --/CR res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5000 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.523724:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.523739:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.523757:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:0.0:1775764762.523760:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764762.523765:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1a00, rc 0) 00000100:00100000:0.0:1775764762.523871:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44987:x1862023076034048:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 245us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.523878:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6317 00000100:00100000:0.0:1775764762.537229:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764762.537302:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076034176 00000100:00100000:2.0:1775764762.537316:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076034176 00000100:00100000:2.0:1775764762.537406:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1664 00000100:00100000:2.0:1775764762.537417:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2410:x1862023076034176:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1775764762.537591:0:8403:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1775764762.537595:0:8403:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb mtime from disk: 0 -> 1775764751 00002000:00010000:2.0:1775764762.537597:0:8403:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb atime from disk: 0 -> 1775764751 00002000:00010000:2.0:1775764762.537600:0:8403:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb ctime from disk: 0 -> 1775764751 00002000:00010000:2.0:1775764762.537602:0:8403:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x52:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:2.0:1775764762.537669:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2410:x1862023076034176:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 Request processed in 253us (448us total) trans 4294967715 rc 0/0 00000100:00100000:2.0:1775764762.537677:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1664 00000100:00100000:3.0:1775764762.546392:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.547151:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076034432 00000100:00100000:1.0:1775764762.547162:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076034432 00000100:00100000:1.0:1775764762.547229:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6318 00000100:00100000:1.0:1775764762.547239:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:44987:x1862023076034432:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1775764762.547317:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.547895:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 2/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 13 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.547906:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 4/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.547950:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 13 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.547999:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 4/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 13 pid: 10681 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.548026:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099775488:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764762.548143:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b02600 going to sleep for 11 seconds 00000100:00100000:1.0:1775764762.562338:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099775488:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764762.562368:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.562752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.563092:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076034560 00000100:00100000:1.0:1775764762.563101:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076034560 00010000:00010000:1.0:1775764762.563136:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 4/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 14 pid: 10681 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.563173:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1364 00000100:00100000:1.0:1775764762.563182:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:2411:x1862023076034560:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764762.563198:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764762.563206:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 4/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 14 pid: 10681 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.563220:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 3/0,0 mode: PR/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 14 pid: 10681 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.563240:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522d62 lrc: 0/0,0 mode: --/PR res: [0x200000406:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fd6 expref: 14 pid: 10681 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.564015:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764762.564022:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.564033:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.564041:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 4/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.564077:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764762.564117:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564125:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.564142:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+13:2411:x1862023076034560:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 960us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.564152:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1364 00010000:00010000:2.0:1775764762.564164:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564171:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 2/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564178:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564184:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.564189:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564201:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 4/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564221:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:2.0:1775764762.564223:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1775764762.564228:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 2/0,0 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.564234:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522dbd lrc: 0/0,0 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764762.564296:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44987:x1862023076034432:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 Request processed in 17058us (17914us total) trans 0 rc -22/-22 00000100:00100000:2.0:1775764762.564304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6318 00000100:00100000:3.0:1775764762.574068:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.579907:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076034688 00000100:00100000:0.0:1775764762.579925:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076034688 00000100:00100000:0.0:1775764762.580036:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1665 00000100:00100000:0.0:1775764762.580046:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2409:x1862023076034688:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1775764762.580104:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.580128:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.580159:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1775764762.580162:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1775764762.580166:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.580208:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.580225:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 7 pid: 8641 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764762.580243:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099775616:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764762.580912:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c3640900 going to sleep for 11 seconds 00000100:00100000:0.0:1775764762.589230:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099775616:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764762.589804:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.590020:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076034816 00000100:00100000:1.0:1775764762.590029:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076034816 00010000:00010000:1.0:1775764762.590069:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 8 pid: 8641 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.590114:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1365 00000100:00100000:1.0:1775764762.590124:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2408:x1862023076034816:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764762.590144:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764762.590165:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 8 pid: 8641 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.590179:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 8 pid: 8641 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.590216:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f54bf147/0x6e98bd47ed522da1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ff9 expref: 8 pid: 8641 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.590232:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764762.590235:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764762.590240:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.590255:0:6505:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.590278:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764762.590333:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+7:2408:x1862023076034816:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 209us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.590341:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1365 00010000:00010000:0.0:1775764762.598547:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598686:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598694:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598727:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598733:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598754:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598759:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8e1400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764762.598762:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598767:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598804:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.598809:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bab66f7/0x6e98bd47ed522dc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.598901:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2409:x1862023076034688:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 18852us (24840us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.598912:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1665 00000100:00100000:3.0:1775764762.608438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.608505:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035072 00000100:00100000:1.0:1775764762.608514:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035072 00000100:00100000:1.0:1775764762.608696:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6319 00000100:00100000:1.0:1775764762.608705:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+12:44987:x1862023076035072:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1775764762.609008:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.609232:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.609250:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.609949:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.609962:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 2/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.609980:0:14288:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 4/0,1 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.610014:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 3/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.610025:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 13 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.610204:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099775744:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764762.610393:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764762.614878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.615704:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035200 00000100:00100000:0.0:1775764762.615716:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035200 00010000:00010000:0.0:1775764762.615761:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 5/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 14 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764762.615842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1366 00000100:00100000:0.0:1775764762.615851:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:2411:x1862023076035200:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764762.615880:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764762.615887:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 5/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 14 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.615899:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 4/0,0 mode: CR/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 14 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.615920:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:0.0:1775764762.615924:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.615933:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.615939:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 4/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.615953:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764762.616015:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+14:2411:x1862023076035200:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 166us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.616022:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1366 00010000:00010000:1.0:1775764762.617130:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8e1a00/0x6e98bd47ed522db6 lrc: 0/0,0 mode: --/CR res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5000 expref: 13 pid: 6522 timeout: 1370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764762.617156:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099775744:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764762.617178:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.617201:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.617207:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1775764762.617322:0:14288:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970537 00000001:00080000:1.0:1775764762.617452:0:14288:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970538 00000001:00080000:1.0:1775764762.617488:0:14288:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970539 00000100:00100000:1.0:1775764762.617577:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14288:1862023099775872:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1775764762.617672:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764762.617731:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d1b7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1775764762.617939:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099775872 00000100:00100000:2.0:1775764762.617946:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099775872 00000100:00100000:2.0:1775764762.618017:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1775764762.618024:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14288:x1862023099775872:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1775764762.618101:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14288:x1862023099775872:12345-0@lo:1000:mdt00_005.0 Request processed in 77us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764762.618106:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1775764762.618251:0:14288:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967713 gen 2 00000004:00080000:0.0:1775764762.618256:0:14288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c1c5595880, transno 4294967712 00000100:00100000:0.0:1775764762.618279:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14288:1862023099775872:0@lo:1000:mdt00_005.0 00000001:00080000:0.0:1775764762.618374:0:14288:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970540 00000100:00100000:0.0:1775764762.618418:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c61180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14288:1862023099776000:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1775764762.618440:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764762.618457:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b02300 going to sleep for 11 seconds 00000100:00100000:3.0:1775764762.618487:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776000 00000100:00100000:3.0:1775764762.618492:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776000 00000100:00100000:3.0:1775764762.618534:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1775764762.618548:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14288:x1862023099776000:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1775764762.618739:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14288:x1862023099776000:12345-0@lo:1000:mdt00_005.0 Request processed in 191us (297us total) trans 4294967716 rc 0/0 00000100:00100000:3.0:1775764762.618745:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1775764762.619158:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c61180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:14288:1862023099776000:0@lo:1000:mdt00_005.0 00000001:00080000:0.0:1775764762.619215:0:14288:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970541 00010000:00010000:0.0:1775764762.619240:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,1 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.619248:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 2/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.619255:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.619261:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764762.619265:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 3/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.619273:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 4/0,0 mode: EX/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.619288:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:0.0:1775764762.619291:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764762.619296:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 2/0,0 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.619302:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522dd2 lrc: 0/0,0 mode: --/EX res: [0x200000406:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620136:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620146:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620152:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620172:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764762.620176:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620182:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620192:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:0.0:1775764762.620195:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764762.620202:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620212:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.620221:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.620388:0:14288:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0600/0x6e98bd47ed522d07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4fc1 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764762.620403:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099776128:192.168.202.58@tcp:105: 00000100:00100000:2.0:1775764762.620494:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c24546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764762.623286:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099776128:192.168.202.58@tcp:105: 00010000:00010000:2.0:1775764762.623431:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623462:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed522d00 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623501:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623516:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623529:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623540:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623546:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623552:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623558:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.623562:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623569:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623581:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:2.0:1775764762.623584:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764762.623588:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623600:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed522dd9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x97:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623610:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623615:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623621:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623626:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764762.623628:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623646:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623654:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:2.0:1775764762.623657:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764762.623659:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 2/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.623665:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522dcb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x97:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764762.623864:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764762.623877:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+17:44987:x1862023076035072:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 15157us (15431us total) trans 4294970542 rc 0/0 00000100:00100000:2.0:1775764762.623890:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6319 00000100:00100000:3.0:1775764762.623892:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035328 00000100:00100000:3.0:1775764762.623898:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035328 00000020:00080000:2.0:1775764762.623902:0:14288:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1775764762.623939:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1322 00000100:00100000:3.0:1775764762.623947:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076035328:12345-192.168.202.58@tcp:49:dd.0 00000100:00100000:3.0:1775764762.624043:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076035328:12345-192.168.202.58@tcp:49:dd.0 Request processed in 98us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.624051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1322 00000040:00080000:0.0:1775764762.624087:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764762.624092:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764762.624586:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1775764762.624596:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764762.627362:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.627442:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035456 00000100:00100000:0.0:1775764762.627453:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035456 00000100:00100000:0.0:1775764762.627695:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1666 00000100:00100000:0.0:1775764762.627709:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:44986:x1862023076035456:12345-192.168.202.58@tcp:101:dd.0 00010000:00010000:0.0:1775764762.627731:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764762.627767:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f02d25/0x6e98bd47ed522de0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5007 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764762.627836:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x52:0x0] initial LVB size: 1048576, mtime: 0x69d8050f, atime: 0x69d8050f, ctime: 0x69d8050f, blocks: 0x800 00010000:00010000:0.0:1775764762.627859:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764762.627861:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764762.627870:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f02d25/0x6e98bd47ed522de0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5007 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.627887:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4f02d25/0x6e98bd47ed522de0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5007 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.627900:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8e1600, rc 0) 00000100:00100000:0.0:1775764762.627950:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:44986:x1862023076035456:12345-192.168.202.58@tcp:101:dd.0 Request processed in 245us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.627957:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1666 00000100:00080000:3.0:1775764762.628106:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764762.657348:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.657460:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035712 00000100:00100000:1.0:1775764762.657473:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035712 00000100:00100000:1.0:1775764762.657556:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1323 00000100:00100000:1.0:1775764762.657566:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dd67c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+17:44987:x1862023076035712:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1775764762.659959:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000406:0x2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1775764762.660022:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970543 00010000:00010000:1.0:1775764762.660070:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 3/0,1 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.660092:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.660105:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 3/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.660115:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 4/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.660144:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 4/0,1 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.660152:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764762.660188:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1775764762.660356:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dd67c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:44987:x1862023076035712:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 2785us (3012us total) trans 4294970544 rc 0/0 00000100:00100000:1.0:1775764762.660367:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1323 00000020:00080000:1.0:1775764762.660375:0:6524:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1775764762.662159:0:6508:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775764762.662175:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 2/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.662186:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1c00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764762.662190:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 2/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.662200:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 3/0,0 mode: PW/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.662219:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:2.0:1775764762.662222:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1775764762.662228:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 1/0,0 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.662234:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed522de7 lrc: 0/0,0 mode: --/PW res: [0x200000406:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764762.662255:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764762.662257:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764762.662259:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764762.697906:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.698978:0:25201:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035840 00000100:00100000:3.0:1775764762.698992:0:25201:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035840 00002000:00100000:3.0:1775764762.699055:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x52:0x0] (0->1048575) req@ffff96c1c2d52300 x1862023076035840/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:243/0 lens 488/0 e 0 to 0 dl 1775764773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764762.699067:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2d52300 with x1862023076035840 ext(0->1048575) 00002000:00010000:3.0:1775764762.699073:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c2d52300 00000100:00100000:3.0:1775764762.699121:0:25201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 420 00000100:00100000:3.0:1775764762.699133:0:25201:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076035840:12345-192.168.202.58@tcp:3:dd.0 00000100:00100000:2.0:1775764762.750445:0:25201:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076035840:12345-192.168.202.58@tcp:3:dd.0 Request processed in 51301us (52537us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1775764762.750460:0:25201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 420 00002000:00100000:2.0:1775764762.750473:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x52:0x0] (0->1048575) req@ffff96c1c2d52300 x1862023076035840/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:243/0 lens 488/440 e 0 to 0 dl 1775764773 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764762.750484:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2d52300 with x1862023076035840 ext(0->1048575) 00002000:00010000:2.0:1775764762.750490:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c2d52300 00000100:00100000:1.0:1775764762.762153:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.762218:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.762272:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.762299:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.762342:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036224 00000100:00100000:1.0:1775764762.762355:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036224 00000100:00100000:1.0:1775764762.762428:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036736 00000100:00100000:1.0:1775764762.762431:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036736 00000100:00100000:1.0:1775764762.762457:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1309 00000100:00100000:1.0:1775764762.762468:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076036224:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764762.762551:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076036224:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.762558:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1309 00000100:00100000:1.0:1775764762.762574:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1310 00000100:00100000:1.0:1775764762.762580:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076036736:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764762.762627:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076036736:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 47us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.762633:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1310 00000100:00080000:1.0:1775764762.762652:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764762.762655:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764762.763047:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.763117:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.764744:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036480 00000100:00100000:0.0:1775764762.764759:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036480 00000100:00100000:0.0:1775764762.764856:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036096 00000100:00100000:0.0:1775764762.764860:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036096 00000100:00100000:0.0:1775764762.764888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1808 00000100:00100000:0.0:1775764762.764898:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076036480:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764762.764994:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076036480:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 97us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.765002:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1808 00000100:00100000:0.0:1775764762.765020:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1809 00000100:00100000:0.0:1775764762.765042:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076036096:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764762.765070:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076036096:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 30us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.765076:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1809 00000100:00080000:0.0:1775764762.765096:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764762.765118:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036992 00000100:00100000:0.0:1775764762.765122:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036992 00000100:00100000:0.0:1775764762.765160:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1311 00000100:00100000:0.0:1775764762.765166:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2408:x1862023076036992:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764762.765194:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2408:x1862023076036992:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.765201:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1311 00000100:00080000:0.0:1775764762.765215:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764762.766077:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076035968 00000100:00100000:2.0:1775764762.766086:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076035968 00000100:00100000:2.0:1775764762.766129:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 945 00000100:00100000:2.0:1775764762.766138:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c37acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+15:2408:x1862023076035968:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764762.778580:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.778669:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.778716:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.778760:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036352 00000100:00100000:1.0:1775764762.778788:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036352 00000100:00100000:1.0:1775764762.778838:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036864 00000100:00100000:1.0:1775764762.778842:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036864 00000100:00100000:1.0:1775764762.778879:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1810 00000100:00100000:1.0:1775764762.778889:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:2408:x1862023076036352:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764762.779329:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:2408:x1862023076036352:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 439us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.779338:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1810 00000100:00100000:1.0:1775764762.779358:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1811 00000100:00100000:1.0:1775764762.779369:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2408:x1862023076036864:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764762.779396:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2408:x1862023076036864:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.779403:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1811 00000100:00080000:1.0:1775764762.779422:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764762.779464:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764762.779639:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076037248 00000100:00100000:1.0:1775764762.779644:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076037248 00000100:00100000:1.0:1775764762.779671:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1324 00000100:00100000:0.0:1775764762.780930:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076036608 00000100:00100000:0.0:1775764762.780938:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076036608 00000100:00100000:0.0:1775764762.781000:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1312 00000100:00100000:0.0:1775764762.781009:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076036608:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764762.781074:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076036608:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 66us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.781081:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1312 00000100:00100000:1.0:1775764762.786539:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076037248:12345-192.168.202.58@tcp:35:dd.0 00000100:00100000:2.0:1775764762.791139:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c37acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+15:2408:x1862023076035968:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24988us (28989us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764762.791158:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 945 00000100:00100000:0.0:1775764762.792501:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+43:44986:x1862023076037248:12345-192.168.202.58@tcp:35:dd.0 Request processed in 12815us (13029us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.792513:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1324 00000100:00100000:1.0:1775764762.817824:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.817897:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076037376 00000100:00100000:0.0:1775764762.817906:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076037376 00000100:00100000:0.0:1775764762.817957:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6320 00000100:00100000:0.0:1775764762.817989:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+43:44988:x1862023076037376:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764762.818017:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764762.818038:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522dee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd500e expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818110:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818205:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818221:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818239:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818246:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818254:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818589:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c200/0x6e98bd47ed522e03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818598:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c200/0x6e98bd47ed522e03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818606:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c200/0x6e98bd47ed522e03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764762.818661:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 1048576 00000004:00200000:0.0:1775764762.818666:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764762.818689:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c200/0x6e98bd47ed522e03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818702:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c200/0x6e98bd47ed522e03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818711:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818718:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818724:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818731:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764762.818736:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818744:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818755:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:0.0:1775764762.818758:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764762.818763:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818814:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed522df5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818840:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818846:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818852:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818857:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764762.818860:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818866:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818874:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x1a471d3 (ffff96c2d572a900) 00010000:00010000:0.0:1775764762.818876:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764762.818879:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818884:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522dfc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x1a471d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818919:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522dee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd500e expref: 45 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818934:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c200/0x6e98bd47ed522e03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd500e expref: 44 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.818952:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:0.0:1775764762.818954:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764762.818957:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c200, rc 0) 00000100:00100000:0.0:1775764762.819031:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+44:44988:x1862023076037376:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1044us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.819039:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6320 00000100:00100000:1.0:1775764762.823012:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764762.823060:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076037504 00000100:00100000:3.0:1775764762.823072:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076037504 00000100:00100000:3.0:1775764762.823137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6321 00000100:00100000:3.0:1775764762.823149:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+44:44988:x1862023076037504:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764762.823183:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764762.823201:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5015 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.823259:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522e11 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.823270:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522e11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.823279:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522e11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764762.823324:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1775764762.823327:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764762.823342:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522e11 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.823361:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5015 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.823373:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8800/0x6e98bd47ed522e11 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5015 expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764762.823379:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:3.0:1775764762.823382:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764762.823384:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8800, rc 0) 00000100:00100000:3.0:1775764762.823433:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+45:44988:x1862023076037504:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 288us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.823437:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6321 00000100:00100000:1.0:1775764762.827575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764762.827650:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076037760 00000100:00100000:0.0:1775764762.827664:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076037760 00000100:00100000:0.0:1775764762.827730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6322 00000100:00100000:0.0:1775764762.827741:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+45:44988:x1862023076037760:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764762.827765:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764762.827831:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e18 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd501c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.828279:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-4126, rc=-4126) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e18 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd501c expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.828291:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x97:0x0].0x0 (ffff96c1c2aa3d00) 00010000:00010000:0.0:1775764762.828293:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1775764762.828296:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e18 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x97:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd501c expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764762.828308:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6da00, rc -4126) 00000100:00100000:0.0:1775764762.828362:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+45:44988:x1862023076037760:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 624us (801us total) trans 0 rc -30/-30 00000100:00100000:0.0:1775764762.828384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6322 00000100:00100000:2.0:1775764762.930288:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099776256:0@lo:400:kworker.0 00000100:00100000:2.0:1775764762.930393:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764762.930637:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099776512:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.930886:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099776384:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.930921:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764762.930983:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099776896:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931007:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764762.931025:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099777408:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931051:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764762.931076:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1775764762.931081:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099776768:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931097:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764762.931113:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099777280:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931126:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764762.931233:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776384 00000100:00100000:3.0:1775764762.931241:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776384 00000100:00100000:3.0:1775764762.931288:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776896 00000100:00100000:3.0:1775764762.931290:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776896 00000100:00100000:3.0:1775764762.931310:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776768 00000100:00100000:3.0:1775764762.931312:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776768 00000100:00100000:3.0:1775764762.931323:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777280 00000100:00100000:3.0:1775764762.931324:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777280 00000100:00100000:3.0:1775764762.931334:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1775764762.931339:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099776384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931379:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099776384:12345-0@lo:400:kworker.0 Request processed in 39us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.931383:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1775764762.931396:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1775764762.931399:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931414:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099776896:12345-0@lo:400:kworker.0 Request processed in 15us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.931430:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1775764762.931438:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1775764762.931441:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099776768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931458:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099776768:12345-0@lo:400:kworker.0 Request processed in 17us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.931462:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1775764762.931468:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1775764762.931471:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099777280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931484:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099777280:12345-0@lo:400:kworker.0 Request processed in 13us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.931487:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1775764762.931516:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099776768:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931527:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099777280:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931535:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099776384:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931543:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099776896:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931575:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777408 00000100:00100000:3.0:1775764762.931578:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777408 00000100:00100000:3.0:1775764762.931608:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1775764762.931615:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099777408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.931651:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099777408:12345-0@lo:400:kworker.0 Request processed in 38us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.931656:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1775764762.931681:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099777408:0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.931885:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764762.931913:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099777024:0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.931942:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764762.931975:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1775764762.931982:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099776640:0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932009:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764762.932104:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099777152:0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932123:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1775764762.932147:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764762.932151:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1775764762.932153:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764762.932159:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776640 00000100:00100000:1.0:1775764762.932162:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776640 00000100:00100000:1.0:1775764762.932179:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777152 00000100:00100000:1.0:1775764762.932181:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777152 00000100:00100000:1.0:1775764762.932226:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:1.0:1775764762.932232:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099776640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932265:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099776640:12345-0@lo:400:kworker.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.932281:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:1.0:1775764762.932293:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1775764762.932296:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099777152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932317:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099777152:12345-0@lo:400:kworker.0 Request processed in 20us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.932320:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00080000:1.0:1775764762.932328:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764762.932344:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099776640:0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932350:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099777152:0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932392:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777024 00000100:00100000:1.0:1775764762.932395:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777024 00000100:00100000:1.0:1775764762.932412:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1775764762.932416:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099777024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764762.932435:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099777024:12345-0@lo:400:kworker.0 Request processed in 20us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764762.932440:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1775764762.932452:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099777024:0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.932598:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776512 00000100:00100000:3.0:1775764762.932602:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776512 00000100:00100000:3.0:1775764762.932636:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1775764762.932643:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099776512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764762.932690:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099776512:12345-0@lo:400:kworker.0 Request processed in 48us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764762.932697:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1775764762.932858:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099776512:0@lo:400:kworker.0 00000100:00100000:0.0:1775764762.933642:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099776256 00000100:00100000:0.0:1775764762.933648:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099776256 00000100:00100000:0.0:1775764762.933680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1775764762.933685:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c37afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099776256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764762.933731:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c37afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099776256:12345-0@lo:400:kworker.0 Request processed in 46us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764762.933735:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1775764762.933761:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099776256:0@lo:400:kworker.0 00000100:00100000:1.0:1775764763.442271:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1775764763.442293:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099777536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764763.442356:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764763.442472:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777536 00000100:00100000:2.0:1775764763.442481:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777536 00000100:00100000:2.0:1775764763.442537:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1775764763.442547:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099777536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764763.442569:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509153472 pending 0 free 3888652288 avail 3656056832 00000100:00100000:2.0:1775764763.442617:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099777536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764763.442625:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1775764763.442672:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099777536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764763.442900:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099777664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764763.442927:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764763.443018:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777664 00000100:00100000:1.0:1775764763.443022:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777664 00000100:00100000:1.0:1775764763.443056:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1775764763.443062:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099777664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764763.443090:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509153472 pending 0 free 3888652288 avail 3656056832 00000100:00100000:1.0:1775764763.443131:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099777664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764763.443137:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1775764763.443206:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099777664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1775764763.506078:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1775764763.978960:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967713 is committed 00000001:00080000:0.0:1775764763.978978:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967710 is committed 00010000:00010000:3.0:1775764764.529981:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764765.490130:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764765.490162:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099777792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764765.490339:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764765.490473:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777792 00000100:00100000:3.0:1775764765.490482:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777792 00000100:00100000:3.0:1775764765.490531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1775764765.490539:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099777792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764765.490573:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 9109504 pending 0 free 1444249600 avail 1298010112 00000100:00100000:3.0:1775764765.492304:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099777792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1756us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764765.492318:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:0.0:1775764765.492756:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099777792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764765.554277:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764765.683904:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764765.683911:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764765.683944:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 145 count 4 00000040:00080000:0.0:1775764765.683954:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764766.517244:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764766.517269:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099777920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764766.517341:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764766.517589:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764766.517599:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099778048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764766.517631:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764766.518947:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099777920 00000100:00100000:1.0:1775764766.518960:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099777920 00000100:00100000:1.0:1775764766.519022:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778048 00000100:00100000:1.0:1775764766.519026:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778048 00000100:00100000:1.0:1775764766.519046:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1775764766.519055:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099777920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764766.519086:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509154368 pending 0 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764766.519150:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099777920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764766.519157:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1775764766.519173:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1775764766.519179:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099778048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764766.519187:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509154368 pending 0 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764766.519214:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099778048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764766.519219:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1775764766.519256:0:3664:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967713 gen 2 00000004:00080000:1.0:1775764766.519262:0:3664:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967711 committed transno 4294967713 00000004:00080000:1.0:1775764766.519280:0:3664:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967712 committed transno 4294967713 00000004:00080000:1.0:1775764766.519289:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c2ff820380, transno 4294967713 00000100:00100000:1.0:1775764766.519305:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099778048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764766.519428:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099777920:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1775764766.519553:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1775764766.578185:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764767.548233:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099778176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764767.548302:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764767.548373:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778176 00000100:00100000:1.0:1775764767.548381:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778176 00000100:00100000:1.0:1775764767.548427:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1775764767.548436:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099778176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764767.548470:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446223872 avail 1299984384 00000100:00100000:1.0:1775764767.548512:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099778176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764767.548520:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1775764767.548562:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099778176:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1775764767.602005:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764767.602014:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764767.602530:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764767.602556:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1775764767.608108:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764767.886236:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764767.886284:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764767.886317:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076037888 00000100:00100000:1.0:1775764767.886325:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764767.886331:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076037888 00000100:00100000:2.0:1775764767.886404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 947 00000100:00100000:2.0:1775764767.886414:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c2beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+15:2411:x1862023076037888:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764767.886542:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c2beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+15:2411:x1862023076037888:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764767.886550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 947 00000100:00100000:0.0:1775764767.895814:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038144 00000100:00100000:0.0:1775764767.895828:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038144 00000100:00100000:1.0:1775764767.898584:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038016 00000100:00100000:1.0:1775764767.898606:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038016 00000100:00100000:1.0:1775764767.898659:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1818 00000100:00100000:1.0:1775764767.898676:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076038144:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764767.898866:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1819 00000100:00100000:1.0:1775764767.898868:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076038144:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 195us (12581us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764767.898879:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1818 00000100:00080000:2.0:1775764767.899026:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764767.899031:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764767.899053:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+45:2411:x1862023076038016:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764767.899106:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+45:2411:x1862023076038016:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 232us (12780us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764767.899113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1819 00000100:00100000:1.0:1775764767.914720:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764767.915356:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038272 00000100:00100000:1.0:1775764767.915733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764767.915824:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038272 00000100:00100000:0.0:1775764767.915903:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1667 00000100:00100000:0.0:1775764767.915913:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2407:x1862023076038272:12345-192.168.202.58@tcp:9:kworker.0 00000020:00000080:0.0:1775764767.915957:0:8641:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x6e98bd47ed50e630 00000100:00080000:0.0:1775764767.915967:0:8641:0:(import.c:65:import_set_state_nolock()) ffff96c1c42df000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1775764767.916019:0:8641:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967713 00000100:00100000:0.0:1775764767.916272:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+2:2407:x1862023076038272:12345-192.168.202.58@tcp:9:kworker.0 Request processed in 360us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764767.916280:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1667 00010000:00010000:3.0:1775764767.918490:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775764767.918503:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764767.919341:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764767.919387:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764767.919445:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038784 00000100:00100000:3.0:1775764767.919455:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038784 00000100:00100000:3.0:1775764767.919518:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1315 00000100:00100000:3.0:1775764767.919529:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076038784:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764767.919619:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076038784:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764767.919627:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1315 00000100:00080000:0.0:1775764767.925382:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764767.932026:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764767.932047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764767.932070:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039296 00000100:00100000:1.0:1775764767.932080:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039296 00000100:00100000:1.0:1775764767.932158:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038400 00000100:00100000:1.0:1775764767.932161:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038400 00000100:00100000:1.0:1775764767.932198:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1316 00000100:00100000:1.0:1775764767.932208:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2411:x1862023076039296:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764767.932284:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2411:x1862023076039296:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764767.932292:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1316 00000100:00100000:1.0:1775764767.932308:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1317 00000100:00100000:1.0:1775764767.932314:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076038400:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764767.932339:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076038400:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764767.932345:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1317 00000100:00080000:1.0:1775764767.932361:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764767.932364:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764767.932652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764767.934113:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038528 00000100:00100000:2.0:1775764767.934125:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038528 00000100:00100000:2.0:1775764767.934261:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039040 00000100:00100000:2.0:1775764767.934265:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039040 00000100:00100000:2.0:1775764767.934300:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1820 00000100:00100000:2.0:1775764767.934310:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:2411:x1862023076038528:12345-192.168.202.58@tcp:400:kworker.0 00000100:00080000:0.0:1775764767.934525:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764767.934715:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:2411:x1862023076038528:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 405us (18983us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764767.934724:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1820 00000100:00100000:2.0:1775764767.934745:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1821 00000100:00100000:2.0:1775764767.934751:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:2411:x1862023076039040:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764767.934818:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+19:2411:x1862023076039040:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 67us (15430us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764767.934826:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1821 00000100:00100000:0.0:1775764767.937363:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038656 00000100:00100000:0.0:1775764767.937381:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038656 00000100:00100000:0.0:1775764767.937450:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1822 00000100:00100000:0.0:1775764767.937460:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076038656:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764767.937525:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076038656:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 68us (4874us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764767.937533:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1822 00000100:00080000:2.0:1775764767.937786:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764767.937979:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764767.938090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764767.938125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764767.938156:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076038912 00000100:00100000:2.0:1775764767.938179:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076038912 00000100:00100000:2.0:1775764767.938224:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039424 00000100:00100000:2.0:1775764767.938227:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039424 00000100:00100000:2.0:1775764767.938246:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1318 00000100:00100000:2.0:1775764767.938253:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076038912:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764767.938292:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076038912:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 40us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764767.938298:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1318 00000100:00100000:2.0:1775764767.938312:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1319 00000100:00100000:2.0:1775764767.938320:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076039424:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764767.938342:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+6:2411:x1862023076039424:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764767.938348:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1319 00000100:00080000:2.0:1775764767.938362:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764767.938798:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039168 00000100:00100000:1.0:1775764767.938803:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039168 00000100:00100000:1.0:1775764767.938848:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1823 00000100:00100000:1.0:1775764767.938856:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2411:x1862023076039168:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764767.938894:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2411:x1862023076039168:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 39us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764767.938910:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1823 00000100:00080000:2.0:1775764767.941542:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764768.056644:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099778304:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.056715:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.056799:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099778816:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.056834:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.056853:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099779328:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.056871:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.056891:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1775764768.056897:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099778432:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.056926:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.056945:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099778944:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.056964:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.056977:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099779456:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.056995:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.057031:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099778560:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.057060:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.057077:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099779072:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.057098:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.057115:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099779584:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.057134:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.057152:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1775764768.057157:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099778688:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.057176:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.057200:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099779200:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.057221:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.057237:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c619ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099779712:0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057383:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778816 00000100:00100000:3.0:1775764768.057400:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778816 00000100:00100000:3.0:1775764768.057445:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779328 00000100:00100000:3.0:1775764768.057448:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779328 00000100:00100000:3.0:1775764768.057460:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778432 00000100:00100000:3.0:1775764768.057462:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778432 00000100:00100000:3.0:1775764768.057471:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778944 00000100:00100000:3.0:1775764768.057473:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778944 00000100:00100000:3.0:1775764768.057483:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779456 00000100:00100000:3.0:1775764768.057486:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779456 00000100:00100000:3.0:1775764768.057496:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778688 00000100:00100000:3.0:1775764768.057498:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778688 00000100:00100000:3.0:1775764768.057510:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:3.0:1775764768.057518:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099778816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057577:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099778816:12345-0@lo:400:kworker.0 Request processed in 59us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.057585:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:3.0:1775764768.057603:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:3.0:1775764768.057608:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099779328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057644:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099779328:12345-0@lo:400:kworker.0 Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.057650:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:3.0:1775764768.057661:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:3.0:1775764768.057666:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099778432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057688:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099778432:12345-0@lo:400:kworker.0 Request processed in 22us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.057700:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:3.0:1775764768.057711:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:3.0:1775764768.057716:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099778944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057740:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099778944:12345-0@lo:400:kworker.0 Request processed in 24us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.057746:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:3.0:1775764768.057755:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1775764768.057760:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057799:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099779456:12345-0@lo:400:kworker.0 Request processed in 39us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.057805:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1775764768.057815:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:3.0:1775764768.057821:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764768.057843:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099778688:12345-0@lo:400:kworker.0 Request processed in 22us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.057849:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:0.0:1775764768.058030:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778304 00000100:00100000:0.0:1775764768.058034:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778304 00000100:00100000:0.0:1775764768.058073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1775764768.058080:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c37af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099778304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764768.058110:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c37af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099778304:12345-0@lo:400:kworker.0 Request processed in 32us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764768.058115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00080000:2.0:1775764768.058392:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1775764768.058397:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764768.058436:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779072 00000100:00100000:2.0:1775764768.058440:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779072 00000100:00100000:2.0:1775764768.058478:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779584 00000100:00100000:2.0:1775764768.058481:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779584 00000100:00100000:2.0:1775764768.058496:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779200 00000100:00100000:2.0:1775764768.058498:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779200 00000100:00100000:2.0:1775764768.058515:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1775764768.058521:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099779072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058553:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099779072:12345-0@lo:400:kworker.0 Request processed in 32us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764768.058559:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1775764768.058580:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1775764768.058586:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099779584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058611:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099779584:12345-0@lo:400:kworker.0 Request processed in 25us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764768.058617:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1775764768.058638:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1775764768.058645:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058668:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099779200:12345-0@lo:400:kworker.0 Request processed in 24us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764768.058673:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1775764768.058691:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099778560 00000100:00100000:2.0:1775764768.058695:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099778560 00000100:00100000:2.0:1775764768.058718:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1775764768.058723:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099778560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058752:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099778560:12345-0@lo:400:kworker.0 Request processed in 29us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764768.058788:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1775764768.058857:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099778432:0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058868:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099778944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058877:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099779456:0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058886:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099778304:0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058897:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099778816:0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.058907:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099779328:0@lo:400:kworker.0 00000100:00080000:0.0:1775764768.059325:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764768.059330:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764768.061052:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764768.061112:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099778560:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.061126:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099779072:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.061138:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099779584:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.061172:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099778688:0@lo:400:kworker.0 00000100:00100000:1.0:1775764768.061182:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099779200:0@lo:400:kworker.0 00000001:00080000:3.0:1775764768.061831:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967716 is committed 00000001:00080000:3.0:1775764768.061842:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967715 is committed 00000100:00100000:2.0:1775764768.062126:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779712 00000100:00100000:2.0:1775764768.062133:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779712 00000100:00100000:2.0:1775764768.062210:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1775764768.062226:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099779712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764768.062334:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099779712:12345-0@lo:400:kworker.0 Request processed in 115us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764768.062342:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00080000:0.0:1775764768.062506:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764768.062977:0:3663:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967716 gen 2 00000004:00080000:1.0:1775764768.062984:0:3663:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967716 committed transno 4294967716 00000100:00100000:1.0:1775764768.063005:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c619ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099779712:0@lo:400:kworker.0 00000001:00080000:0.0:1775764768.063193:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970544 is committed 00000020:00080000:0.0:1775764768.063226:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2c3640240 refcount 2 committed 0 result 0 batchid 119 00000020:00080000:0.0:1775764768.063231:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c2ff8d4e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2c3640900 00000020:00080000:0.0:1775764768.063235:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c2ff8d4d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2daf800 00000020:00080000:3.0:1775764768.063313:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 119 committed batchid 116 00000020:00080000:3.0:1775764768.063381:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 116 00000020:00080000:0.0:1775764768.063485:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 118 batchid updated 00010000:00010000:1.0:1775764768.063925:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,1 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764768.063939:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 2/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764768.063947:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764768.063952:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764768.063958:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 3/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764768.063965:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 4/0,0 mode: TXN/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764768.064004:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000406:0x2:0x0].0x0 (ffff96c1c4135000) 00010000:00010000:1.0:1775764768.064007:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764768.064012:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 2/0,0 mode: --/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764768.064018:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522daf lrc: 0/0,0 mode: --/TXN res: [0x200000406:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764768.561992:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764768.562013:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099779840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764768.562075:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764768.562238:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779840 00000100:00100000:0.0:1775764768.562246:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779840 00000100:00100000:0.0:1775764768.562296:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1775764768.562305:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099779840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1775764768.562492:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509153472 pending 0 free 3887603712 avail 3656081408 00000100:00100000:0.0:1775764768.562546:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099779840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 241us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764768.562659:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1775764768.562719:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099779840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764768.566502:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775764768.566528:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099779968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764768.566597:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764768.566880:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099779968 00000100:00100000:3.0:1775764768.566889:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099779968 00000100:00100000:3.0:1775764768.566941:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1775764768.566950:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099779968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1775764768.566972:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 509153472 pending 0 free 3887603712 avail 3656081408 00000100:00100000:3.0:1775764768.567029:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099779968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764768.567036:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1775764768.567078:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099779968:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1775764768.627022:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764769.654367:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764770.488854:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764770.488941:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039552 00000100:00100000:3.0:1775764770.488951:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039552 00000100:00100000:3.0:1775764770.489026:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6323 00000100:00100000:3.0:1775764770.489038:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+45:45415:x1862023076039552:12345-192.168.202.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1775764770.489057:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764770.489089:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5023 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489150:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489164:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489176:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489200:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489208:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489214:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489270:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489278:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489284:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489291:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764770.489295:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489302:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489315:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764770.489318:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764770.489323:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489329:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489341:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489347:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489352:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489363:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764770.489365:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489372:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489379:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x577698cc (ffff96c1c2a03000) 00010000:00010000:3.0:1775764770.489381:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764770.489384:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489391:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522e2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x577698cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489424:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5023 expref: 46 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489435:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764770.489438:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764770.489441:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5023 expref: 46 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764770.489450:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764770.489511:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+45:45415:x1862023076039552:12345-192.168.202.58@tcp:101:mount.lustre.0 Request processed in 475us (667us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764770.489518:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6323 00000100:00080000:0.0:1775764770.489884:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764770.499862:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764770.500309:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039680 00000100:00100000:2.0:1775764770.500322:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039680 00000100:00100000:2.0:1775764770.500404:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6324 00000100:00100000:2.0:1775764770.500415:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+45:45415:x1862023076039680:12345-192.168.202.58@tcp:46:mount.lustre.0 00000100:00100000:2.0:1775764770.500522:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+45:45415:x1862023076039680:12345-192.168.202.58@tcp:46:mount.lustre.0 Request processed in 108us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764770.500531:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6324 00000100:00100000:2.0:1775764770.506907:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764770.507008:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039808 00000100:00100000:1.0:1775764770.507021:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039808 00000100:00100000:1.0:1775764770.507099:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6325 00000100:00100000:1.0:1775764770.507111:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:45415:x1862023076039808:12345-192.168.202.58@tcp:46:mount.lustre.0 00000100:00100000:1.0:1775764770.507205:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:45415:x1862023076039808:12345-192.168.202.58@tcp:46:mount.lustre.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764770.507212:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6325 00000100:00080000:0.0:1775764770.508010:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764770.611338:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1775764770.611372:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099780096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764770.611443:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764770.611640:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780096 00000100:00100000:3.0:1775764770.611672:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780096 00000100:00100000:3.0:1775764770.611732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1775764770.611741:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099780096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764770.611816:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 9109504 pending 0 free 1444249600 avail 1298010112 00000100:00100000:3.0:1775764770.611879:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099780096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764770.611887:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1775764770.611949:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099780096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764770.651579:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764770.651813:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076039936 00000100:00100000:2.0:1775764770.651823:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076039936 00000100:00100000:2.0:1775764770.651912:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6326 00000100:00100000:2.0:1775764770.651923:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+9:44803:x1862023076039936:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1775764770.652112:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9cbd2dce-6222-4b9d-952e-2776ae7cef01+9:44803:x1862023076039936:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 188us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764770.652120:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6326 00000100:00080000:0.0:1775764770.652244:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764770.658844:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764770.659048:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040064 00000100:00100000:1.0:1775764770.659059:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040064 00000100:00100000:1.0:1775764770.659137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6327 00000100:00100000:1.0:1775764770.659146:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:44803:x1862023076040064:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1775764770.659268:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:44803:x1862023076040064:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 122us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764770.659275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6327 00000100:00080000:0.0:1775764770.659339:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764770.664948:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764770.665159:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040320 00000100:00100000:3.0:1775764770.665171:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040320 00000100:00100000:3.0:1775764770.665236:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1325 00000100:00100000:3.0:1775764770.665246:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+9:44803:x1862023076040320:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764770.665705:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:44803:x1862023076040320:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 460us (766us total) trans 4294970545 rc 0/0 00000100:00100000:3.0:1775764770.665714:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1325 00010000:00010000:3.0:1775764770.674116:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764771.634103:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764771.634128:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099780224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764771.634198:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764771.634315:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780224 00000100:00100000:2.0:1775764771.634324:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780224 00000100:00100000:0.0:1775764771.634375:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764771.634384:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099780352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764771.634392:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1775764771.634401:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099780224:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764771.634412:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1775764771.634431:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 24515648 pending 0 free 3916959744 avail 3685437440 00000100:00100000:0.0:1775764771.634456:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780352 00000100:00100000:0.0:1775764771.634459:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780352 00000100:00100000:0.0:1775764771.634480:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1775764771.634486:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099780352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764771.634496:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 24515648 pending 0 free 3916959744 avail 3685437440 00000100:00100000:0.0:1775764771.634524:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099780352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764771.634531:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1775764771.634573:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099780352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764771.634637:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099780224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764771.634645:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:3.0:1775764771.634919:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764771.635421:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099780224:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1775764771.698193:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764771.941753:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764771.941833:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764771.941886:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764771.941967:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040448 00000100:00100000:3.0:1775764771.941977:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040448 00000100:00100000:3.0:1775764771.942036:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040704 00000100:00100000:3.0:1775764771.942040:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040704 00000100:00100000:3.0:1775764771.942092:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040576 00000100:00100000:3.0:1775764771.942095:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040576 00000100:00100000:3.0:1775764771.942118:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 733 00000100:00100000:3.0:1775764771.942127:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bc78d45-5379-4d62-8e28-79875d287077+17:2409:x1862023076040448:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764771.942156:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764771.942175:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96c1c43cea00/0x6e98bd47ed5229e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e78 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764771.942192:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764771.942249:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bc78d45-5379-4d62-8e28-79875d287077+16:2409:x1862023076040448:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 114us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764771.942258:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 733 00000100:00100000:3.0:1775764771.942277:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 734 00000100:00100000:3.0:1775764771.942283:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bc78d45-5379-4d62-8e28-79875d287077+15:2409:x1862023076040704:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764771.942290:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764771.942299:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96c2ffa91800/0x6e98bd47ed5229f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4eb0 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764771.942308:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764771.942326:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bc78d45-5379-4d62-8e28-79875d287077+14:2409:x1862023076040704:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764771.942333:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 734 00000100:00100000:3.0:1775764771.942374:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 735 00000100:00100000:3.0:1775764771.942380:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bc78d45-5379-4d62-8e28-79875d287077+13:2409:x1862023076040576:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764771.942387:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764771.942396:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96c2ff8e1c00/0x6e98bd47ed5229f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ea9 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764771.942404:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764771.942420:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076040576:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 41us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764771.942432:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 735 00000100:00100000:0.0:1775764771.960087:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764771.960440:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040832 00000100:00100000:2.0:1775764771.960452:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040832 00000100:00100000:2.0:1775764771.960533:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1668 00000100:00100000:2.0:1775764771.960544:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2407:x1862023076040832:12345-192.168.202.58@tcp:9:umount.0 00000020:00000080:2.0:1775764771.960578:0:8405:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x6e98bd47ed522a13 00000100:00080000:2.0:1775764771.960586:0:8405:0:(import.c:65:import_set_state_nolock()) ffff96c2c3eab800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1775764771.960628:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1775764771.960644:0:8405:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967716 00000100:00100000:2.0:1775764771.960840:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbd2dce-6222-4b9d-952e-2776ae7cef01+2:2407:x1862023076040832:12345-192.168.202.58@tcp:9:umount.0 Request processed in 297us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764771.960861:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1668 00010000:00010000:0.0:1775764771.963071:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764771.963807:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764771.964234:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076040960 00000100:00100000:2.0:1775764771.964244:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076040960 00000100:00080000:3.0:1775764771.964308:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764771.964337:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1669 00000100:00100000:2.0:1775764771.964347:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2407:x1862023076040960:12345-192.168.202.58@tcp:9:umount.0 00000020:00000080:2.0:1775764771.964377:0:8641:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x6e98bd47ed522a0c 00000100:00080000:2.0:1775764771.964385:0:8641:0:(import.c:65:import_set_state_nolock()) ffff96c1c4df0800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1775764771.964416:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1775764771.964431:0:8641:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967713 00000100:00100000:2.0:1775764771.966367:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbd2dce-6222-4b9d-952e-2776ae7cef01+2:2407:x1862023076040960:12345-192.168.202.58@tcp:9:umount.0 Request processed in 2011us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764771.966381:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1669 00000100:00100000:3.0:1775764771.972352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764771.973617:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076041600 00000100:00100000:0.0:1775764771.973629:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076041600 00000100:00100000:0.0:1775764771.973706:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6328 00000100:00100000:0.0:1775764771.973717:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+10:2407:x1862023076041600:12345-192.168.202.58@tcp:39:umount.0 00000020:00000080:0.0:1775764771.973752:0:6521:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x6e98bd47ed5229fe 00000020:00010000:0.0:1775764771.973759:0:6521:0:(genops.c:1940:obd_stale_export_put()) Put export ffff96c1c488b800: total 0 00000100:00080000:0.0:1775764771.973764:0:6521:0:(import.c:65:import_set_state_nolock()) ffff96c1c4889800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1775764771.973841:0:6521:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294970545 00000020:00010000:3.0:1775764771.975351:0:9476:0:(genops.c:1926:obd_stale_export_get()) Get export ffff96c1c488b800: total 0 00010000:00010000:3.0:1775764771.975410:0:9476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96c1c488b800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1775764771.975442:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:3.0:1775764771.975446:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764771.975456:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed522a3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ee8 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764771.976136:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbd2dce-6222-4b9d-952e-2776ae7cef01+8:2407:x1862023076041600:12345-192.168.202.58@tcp:39:umount.0 Request processed in 2419us (3792us total) trans 4294970546 rc 0/0 00000100:00100000:0.0:1775764771.976147:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6328 00010000:00010000:3.0:1775764771.976306:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764771.976309:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764771.976315:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522a21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4ee1 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764771.976330:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764771.976332:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764771.976336:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf600/0x6e98bd47ed522a59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4eef expref: 6 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764771.976347:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff96c2f7009400) 00010000:00010000:3.0:1775764771.976349:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1775764771.976353:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522bd3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4f5f expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764771.976362:0:9476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96c1c488b800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1775764771.976396:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764771.976398:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764771.976400:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764771.983429:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764771.983570:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076041728 00000100:00100000:2.0:1775764771.983579:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076041728 00000100:00100000:2.0:1775764771.983650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6329 00000100:00100000:2.0:1775764771.983658:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+5:2407:x1862023076041728:12345-192.168.202.58@tcp:39:umount.0 00000020:00000080:2.0:1775764771.983691:0:6522:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x6e98bd47ed522a05 00000100:00080000:2.0:1775764771.983698:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96c1c488f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1775764771.983722:0:6522:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294968423 00010000:00010000:3.0:1775764771.983950:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764771.983958:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbd2dce-6222-4b9d-952e-2776ae7cef01+3:2407:x1862023076041728:12345-192.168.202.58@tcp:39:umount.0 Request processed in 300us (536us total) trans 4294968424 rc 0/0 00000100:00100000:2.0:1775764771.983967:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6329 00000100:00100000:0.0:1775764772.658231:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099780480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764772.658305:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764772.664457:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780480 00000100:00100000:2.0:1775764772.664475:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780480 00000100:00100000:2.0:1775764772.664544:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1775764772.664555:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099780480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1775764772.664607:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:2.0:1775764772.664696:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099780480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (6389us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764772.664703:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1775764772.664928:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099780480:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764772.722052:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764773.003083:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003129:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003159:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003198:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003215:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003238:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003253:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003275:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764773.003300:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042112 00000100:00100000:1.0:1775764773.003309:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042112 00000100:00100000:1.0:1775764773.003376:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042368 00000100:00100000:1.0:1775764773.003379:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042368 00000100:00100000:1.0:1775764773.003397:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076041984 00000100:00100000:1.0:1775764773.003399:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076041984 00000100:00100000:1.0:1775764773.003415:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042496 00000100:00100000:1.0:1775764773.003418:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042496 00000100:00100000:1.0:1775764773.003435:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1830 00000100:00100000:1.0:1775764773.003445:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076042112:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003520:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076042112:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 75us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003528:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1830 00000100:00100000:1.0:1775764773.003545:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1831 00000100:00100000:1.0:1775764773.003551:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:2408:x1862023076042368:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003577:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:2408:x1862023076042368:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003611:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1831 00000100:00100000:1.0:1775764773.003626:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1832 00000100:00100000:1.0:1775764773.003632:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+45:2408:x1862023076041984:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003658:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+45:2408:x1862023076041984:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003664:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1832 00000100:00100000:1.0:1775764773.003675:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1833 00000100:00100000:1.0:1775764773.003680:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076042496:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003703:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076042496:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003708:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1833 00000100:00100000:1.0:1775764773.003733:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042624 00000100:00100000:1.0:1775764773.003736:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042624 00000100:00100000:1.0:1775764773.003761:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042240 00000100:00100000:1.0:1775764773.003764:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042240 00000100:00100000:1.0:1775764773.003816:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042752 00000100:00100000:1.0:1775764773.003819:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042752 00000100:00100000:1.0:1775764773.003836:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1324 00000100:00100000:1.0:1775764773.003842:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076042624:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003880:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076042624:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003887:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1324 00000100:00100000:1.0:1775764773.003898:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1325 00000100:00100000:1.0:1775764773.003905:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076042240:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003938:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076042240:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 34us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003944:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1325 00000100:00100000:1.0:1775764773.003956:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1326 00000100:00100000:1.0:1775764773.003962:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076042752:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764773.003983:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076042752:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.003990:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1326 00000100:00080000:3.0:1775764773.004202:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764773.004206:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764773.004209:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764773.004211:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764773.007154:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076041856 00000100:00100000:2.0:1775764773.007182:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076041856 00000100:00100000:2.0:1775764773.007268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 949 00000100:00100000:2.0:1775764773.007279:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c85f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076041856:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764773.007379:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c85f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076041856:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 103us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764773.007387:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 949 00000100:00100000:3.0:1775764773.171997:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099780864:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.172081:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764773.172141:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099781376:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.172176:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764773.172194:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099781888:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.172215:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764773.172238:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1775764773.172243:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099780992:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.172264:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764773.172284:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099781504:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.172304:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173528:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099780736:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.173593:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173624:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099781248:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.173646:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173663:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099781760:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.173685:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173722:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1775764773.173729:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099780608:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.173758:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173811:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c1cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099781120:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.173833:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173851:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099781632:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.173881:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.173917:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780608 00000100:00100000:0.0:1775764773.173926:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780608 00000100:00100000:0.0:1775764773.173971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1775764773.173981:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c85f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099780608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174048:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c85f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099780608:12345-0@lo:400:kworker.0 Request processed in 68us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1775764773.174086:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780992 00000100:00100000:0.0:1775764773.174089:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780992 00000100:00100000:0.0:1775764773.174108:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780736 00000100:00100000:0.0:1775764773.174111:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780736 00000100:00100000:0.0:1775764773.174120:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781248 00000100:00100000:0.0:1775764773.174122:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781248 00000100:00100000:0.0:1775764773.174142:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781760 00000100:00100000:0.0:1775764773.174144:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781760 00000100:00100000:0.0:1775764773.174154:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781120 00000100:00100000:0.0:1775764773.174156:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781120 00000100:00100000:0.0:1775764773.174165:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781632 00000100:00100000:0.0:1775764773.174167:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781632 00000100:00100000:0.0:1775764773.174177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:0.0:1775764773.174182:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099780992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174210:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099780992:12345-0@lo:400:kworker.0 Request processed in 28us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174216:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:0.0:1775764773.174227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1775764773.174233:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099780736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174257:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099780736:12345-0@lo:400:kworker.0 Request processed in 25us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174263:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1775764773.174288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1775764773.174294:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099781248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174337:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099781248:12345-0@lo:400:kworker.0 Request processed in 43us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174349:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1775764773.174365:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1775764773.174371:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099781760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174400:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099781760:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1775764773.174420:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:0.0:1775764773.174426:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099781120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174452:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099781120:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174458:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:0.0:1775764773.174468:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:0.0:1775764773.174473:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099781632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174498:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099781632:12345-0@lo:400:kworker.0 Request processed in 26us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.174504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00080000:0.0:1775764773.174522:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1775764773.174526:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764773.174561:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099780608:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174573:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c1cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099781120:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174581:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099781632:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174590:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099780736:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174598:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099781248:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.174617:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099781760:0@lo:400:kworker.0 00000100:00100000:2.0:1775764773.174790:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099780864 00000100:00100000:2.0:1775764773.174795:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099780864 00000100:00100000:2.0:1775764773.174831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1775764773.174837:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099780864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764773.174887:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099780864:12345-0@lo:400:kworker.0 Request processed in 50us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764773.174893:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1775764773.185725:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099782016:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.185798:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764773.190831:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781376 00000100:00100000:1.0:1775764773.190847:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781376 00000100:00100000:1.0:1775764773.190967:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781888 00000100:00100000:1.0:1775764773.190972:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781888 00000100:00100000:1.0:1775764773.191001:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099781504 00000100:00100000:1.0:1775764773.191004:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099781504 00000100:00100000:1.0:1775764773.191029:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1775764773.191038:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099781376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764773.191134:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099781376:12345-0@lo:400:kworker.0 Request processed in 96us (18965us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.191141:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1775764773.191161:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1775764773.191178:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099781888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764773.191209:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099781888:12345-0@lo:400:kworker.0 Request processed in 43us (18993us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.191215:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1775764773.191227:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1775764773.191233:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099781504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764773.191277:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099781504:12345-0@lo:400:kworker.0 Request processed in 45us (18972us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764773.191283:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00080000:1.0:1775764773.191332:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764773.191337:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764773.192328:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099782016 00000100:00100000:3.0:1775764773.192336:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099782016 00000100:00100000:3.0:1775764773.192385:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1775764773.192393:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099782016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.192437:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099782016:12345-0@lo:400:kworker.0 Request processed in 45us (6639us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764773.192455:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:3.0:1775764773.192473:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764773.192507:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099782016:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.192521:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099780864:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.192532:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099781376:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.192541:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099781888:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.192597:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099780992:0@lo:400:kworker.0 00000100:00100000:3.0:1775764773.192609:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099781504:0@lo:400:kworker.0 00000100:00100000:0.0:1775764773.682438:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764773.682462:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099782144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764773.682531:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764773.682597:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099782144 00000100:00100000:0.0:1775764773.682607:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099782144 00000100:00100000:0.0:1775764773.682656:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1775764773.682665:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099782144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1775764773.682695:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 493351104 pending 0 free 3887603712 avail 3656081408 00000100:00100000:0.0:1775764773.682739:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099782144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764773.682746:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1775764773.682809:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099782144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764773.682968:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764773.682978:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099782272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764773.683007:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764773.683067:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099782272 00000100:00100000:3.0:1775764773.683071:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099782272 00000100:00100000:3.0:1775764773.683104:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1775764773.683111:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099782272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1775764773.683122:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 493351104 pending 0 free 3887603712 avail 3656081408 00000100:00100000:3.0:1775764773.683154:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099782272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764773.683170:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1775764773.683297:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099782272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1775764773.746006:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775764774.167336:0:29626:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 15:59:31 (1775764771) 00000001:00100000:0.0:1775764774.212282:0:8398:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000020:00000080:0.0:1775764774.212291:0:8398:0:(genops.c:904:class_export_put()) final put ffff96c1c4df2800/9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000001:00100000:0.0:1775764774.212317:0:8398:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2bb64567-481f-43c2-999a-8c9c071338ae 00000020:00000080:0.0:1775764774.212319:0:8398:0:(genops.c:904:class_export_put()) final put ffff96c1c42dc000/2bb64567-481f-43c2-999a-8c9c071338ae 00000020:00000080:2.0:1775764774.212809:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff96c1c4df2800/9cbd2dce-6222-4b9d-952e-2776ae7cef01 for lustre-OST0000 00000020:00000080:2.0:1775764774.212873:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff96c1c42dc000/2bb64567-481f-43c2-999a-8c9c071338ae for lustre-OST0000 00000020:00000080:2.0:1775764774.212902:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff96c1c4df0800 for lustre-OST0000 00000020:00000080:2.0:1775764774.212906:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff96c1c42df000 for lustre-OST0000 00000001:00100000:2.0:1775764774.213521:0:6499:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000001:00080000:2.0:1775764774.213531:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970546 is committed 00000020:00000080:2.0:1775764774.213536:0:6499:0:(genops.c:904:class_export_put()) final put ffff96c1c488b800/9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000020:00080000:2.0:1775764774.213559:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 119 batchid updated 00000020:00080000:3.0:1775764774.216325:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 119 00000020:00080000:3.0:1775764774.216349:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 119 00000020:00000080:0.0:1775764774.222107:0:38:0:(genops.c:863:class_export_destroy()) destroying export ffff96c1c488b800/9cbd2dce-6222-4b9d-952e-2776ae7cef01 for lustre-MDT0000 00000020:00000080:0.0:1775764774.222195:0:38:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff96c1c4889800 for lustre-MDT0000 00000100:00100000:1.0:1775764774.599399:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764774.599492:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076042880 00000100:00100000:0.0:1775764774.599503:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076042880 00000100:00100000:0.0:1775764774.599566:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6330 00000100:00100000:0.0:1775764774.599576:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+45:45621:x1862023076042880:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764774.599596:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764774.599617:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed522e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd502a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599690:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599703:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599715:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599728:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599734:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599739:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599835:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599844:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599850:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764774.599892:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1775764774.599896:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764774.599915:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599936:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599942:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599948:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599955:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599961:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764774.599965:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599971:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599982:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764774.599985:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764774.599989:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.599995:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600020:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600027:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600038:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600043:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764774.600046:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600052:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600059:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96c1c2a02500) 00010000:00010000:0.0:1775764774.600061:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764774.600064:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600068:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522e42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600099:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed522e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd502a expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600113:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd502a expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.600120:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:0.0:1775764774.600122:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764774.600125:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6da00, rc 0) 00000100:00100000:0.0:1775764774.600272:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+46:45621:x1862023076042880:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 696us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764774.600289:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6330 00000100:00100000:1.0:1775764774.612896:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.612942:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764774.613028:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076043136 00000100:00100000:2.0:1775764774.613041:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076043136 00000100:00100000:2.0:1775764774.613100:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6331 00000100:00100000:2.0:1775764774.613110:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+46:45621:x1862023076043136:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764774.613132:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764774.613168:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522e50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5031 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613244:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613258:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613268:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613283:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613290:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613297:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613383:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522e65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613393:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522e65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613401:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522e65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764774.613412:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1775764774.613499:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613516:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613522:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613527:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764774.613531:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613538:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613550:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:2.0:1775764774.613553:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764774.613558:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613564:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed522e57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613576:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613583:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613589:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613595:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764774.613604:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613610:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613618:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c1c7207200) 00010000:00010000:2.0:1775764774.613621:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764774.613624:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613630:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613928:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed522e50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5031 expref: 49 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613944:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522e65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5031 expref: 48 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.613951:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764774.613953:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764774.613956:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0a00, rc 0) 00000100:00100000:2.0:1775764774.614016:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+48:45621:x1862023076043136:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 908us (1074us total) trans 4294970547 rc 0/0 00000100:00100000:2.0:1775764774.614024:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6331 00000100:00100000:3.0:1775764774.614605:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076043264 00000100:00100000:3.0:1775764774.614613:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076043264 00000100:00100000:3.0:1775764774.614664:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 736 00000100:00100000:3.0:1775764774.614672:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:2411:x1862023076043264:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764774.614691:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764774.614707:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed522e49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd502a expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.614719:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:3.0:1775764774.614723:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764774.614805:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:2411:x1862023076043264:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 133us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764774.614812:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 736 00000100:00100000:2.0:1775764774.627336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.628946:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076043520 00000100:00100000:1.0:1775764774.628960:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076043520 00000100:00100000:1.0:1775764774.629025:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1326 00000100:00100000:1.0:1775764774.629034:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+47:45621:x1862023076043520:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764774.629268:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+48:45621:x1862023076043520:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 234us (1944us total) trans 4294970548 rc 0/0 00000100:00100000:1.0:1775764774.629276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1326 00000100:00100000:2.0:1775764774.631059:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.631158:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076043648 00000100:00100000:1.0:1775764774.631169:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076043648 00000100:00100000:1.0:1775764774.631231:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6332 00000100:00100000:1.0:1775764774.631241:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+48:45621:x1862023076043648:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764774.631360:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+48:45621:x1862023076043648:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764774.631386:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6332 00000100:00100000:3.0:1775764774.634349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764774.634630:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076043776 00000100:00100000:0.0:1775764774.634639:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076043776 00000100:00100000:0.0:1775764774.634701:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 737 00000100:00100000:0.0:1775764774.634712:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+48:2408:x1862023076043776:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764774.634726:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764774.634752:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed522e65 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5031 expref: 48 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.634816:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764774.634822:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764774.634887:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+47:2408:x1862023076043776:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 178us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764774.634896:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 737 00000100:00100000:3.0:1775764774.638523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.638732:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076043904 00000100:00100000:1.0:1775764774.638743:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076043904 00000100:00100000:1.0:1775764774.639193:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6333 00000100:00100000:1.0:1775764774.639205:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:45622:x1862023076043904:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764774.639224:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764774.639243:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5038 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639400:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639415:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639426:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639441:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639448:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639455:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639579:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639604:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639611:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639617:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764774.639621:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639629:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639642:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764774.639644:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.639649:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639655:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639669:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639675:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639680:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639685:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764774.639694:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639701:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639708:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac064746 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764774.639711:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.639714:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639719:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639751:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522e73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5038 expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.639762:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764774.639764:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.639767:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5038 expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.641342:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1800, rc 0) 00000100:00100000:1.0:1775764774.641426:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:45622:x1862023076043904:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 2221us (2910us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764774.641436:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6333 00000100:00100000:3.0:1775764774.642138:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.642904:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076044032 00000100:00100000:1.0:1775764774.642917:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076044032 00000100:00100000:1.0:1775764774.643093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6334 00000100:00100000:1.0:1775764774.643103:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:45621:x1862023076044032:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764774.643225:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:45621:x1862023076044032:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 123us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764774.643232:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6334 00000100:00100000:3.0:1775764774.651187:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764774.659248:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076044288 00000100:00100000:2.0:1775764774.659355:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076044288 00000100:00100000:2.0:1775764774.659436:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6335 00000100:00100000:2.0:1775764774.659457:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:45622:x1862023076044288:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:2.0:1775764774.659518:0:10088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764774.659554:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52298e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e5c expref: 19 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.659577:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764774.659582:0:10088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764774.659651:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.659667:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.659676:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.659716:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.659731:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 46 pid: 10681 timeout: 1382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764774.659745:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099782400:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764774.660689:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa06900 going to sleep for 11 seconds 00000100:00100000:2.0:1775764774.664315:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764774.666062:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099782400:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764774.666093:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764774.671369:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076044416 00000100:00100000:2.0:1775764774.671403:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076044416 00010000:00010000:2.0:1775764774.671466:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 47 pid: 10681 timeout: 1382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764774.671512:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1367 00000100:00100000:2.0:1775764774.671521:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+47:2410:x1862023076044416:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764774.671537:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764774.671544:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 47 pid: 10681 timeout: 1382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.671558:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 47 pid: 10681 timeout: 1382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.671581:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed522909 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd4e32 expref: 47 pid: 10681 timeout: 1382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.671599:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764774.671605:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.671615:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.671623:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764774.671645:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764774.671703:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+46:2410:x1862023076044416:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 183us (7399us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764774.671719:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1367 00010000:00010000:3.0:1775764774.672015:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672025:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672048:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xac064746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672058:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672077:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672588:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672599:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672607:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764774.672620:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a3688f8a reply state 00000000281bebba transno 4294970549 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672631:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672638:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:3.0:1775764774.672641:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764774.672644:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1775764774.672649:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1775764774.672655:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672662:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672669:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672675:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764774.672685:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672693:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672702:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764774.672704:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764774.672708:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672713:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed522e88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764774.672724:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a3688f8a reply state 00000000281bebba transno 4294970549 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672731:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.672736:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac064746 (ffff96c1c2a03000) 00010000:00010000:3.0:1775764774.672739:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764774.672740:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1775764774.672839:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:45622:x1862023076044288:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 13393us (21664us total) trans 4294970549 rc 0/0 00000100:00100000:3.0:1775764774.672848:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6335 00000100:00100000:2.0:1775764774.724872:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.725052:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076044544 00000100:00100000:1.0:1775764774.725062:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076044544 00000100:00100000:1.0:1775764774.725121:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6336 00000100:00100000:1.0:1775764774.725132:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+46:45626:x1862023076044544:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:1.0:1775764774.725157:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764774.725177:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522e9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd503f expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.725242:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ea4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.725257:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.725270:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764774.725319:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764774.725323:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764774.725341:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.725367:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522e9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd503f expref: 48 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.725388:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd503f expref: 47 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.725562:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764774.725565:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764774.725570:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc 0) 00000100:00100000:1.0:1775764774.725633:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+47:45626:x1862023076044544:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 502us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764774.725641:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6336 00000100:00100000:2.0:1775764774.731211:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.731338:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076044800 00000100:00100000:1.0:1775764774.731349:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076044800 00000100:00100000:1.0:1775764774.731417:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6337 00000100:00100000:1.0:1775764774.731427:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:45626:x1862023076044800:12345-192.168.202.58@tcp:36:mkdir.0 00010000:00010000:1.0:1775764774.731486:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764774.731515:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ea4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd503f expref: 47 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.731536:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764774.731541:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764774.731669:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+46:45626:x1862023076044800:12345-192.168.202.58@tcp:36:mkdir.0 Request processed in 243us (471us total) trans 0 rc -17/-17 00000100:00100000:1.0:1775764774.731677:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6337 00000100:00100000:2.0:1775764774.735151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764774.735236:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076044928 00000100:00100000:3.0:1775764774.735246:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076044928 00000100:00100000:3.0:1775764774.735302:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6338 00000100:00100000:3.0:1775764774.735313:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+46:45626:x1862023076044928:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:3.0:1775764774.735334:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764774.735369:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5046 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.735436:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.735451:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.735463:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764774.735504:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1775764774.735508:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764774.735529:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.735553:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 48 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.735572:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 47 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.735580:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764774.735583:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764774.735586:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8600, rc 0) 00000100:00100000:3.0:1775764774.735651:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+47:45626:x1862023076044928:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 341us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764774.735658:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6338 00000100:00100000:2.0:1775764774.738415:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764774.738541:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045056 00000100:00100000:0.0:1775764774.738551:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045056 00000100:00100000:0.0:1775764774.738611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6339 00000100:00100000:0.0:1775764774.738622:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+47:45626:x1862023076045056:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:0.0:1775764774.738643:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764774.738663:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed522eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd504d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738736:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738750:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738803:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738818:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738825:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738832:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738921:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522ece lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738929:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522ece lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.738935:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522ece lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764774.738971:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1775764774.738974:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764774.738992:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522ece lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739005:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739011:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739027:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739033:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739038:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764774.739043:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739049:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739060:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764774.739063:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764774.739068:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739073:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed522ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739087:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739092:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739098:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739103:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764774.739111:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739117:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739125:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac064746 (ffff96c1c2a03000) 00010000:00010000:0.0:1775764774.739127:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764774.739129:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739134:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed522ec7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739161:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed522eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd504d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739174:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522ece lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd504d expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764774.739180:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:0.0:1775764774.739182:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764774.739184:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c600, rc 0) 00000100:00100000:0.0:1775764774.739247:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+48:45626:x1862023076045056:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 626us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764774.739254:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6339 00000100:00100000:2.0:1775764774.757202:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.757316:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045184 00000100:00100000:1.0:1775764774.757328:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045184 00000100:00100000:1.0:1775764774.757400:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6340 00000100:00100000:1.0:1775764774.757411:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ffa26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:45627:x1862023076045184:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764774.757434:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764774.757457:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ed5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5054 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757541:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757557:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757569:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757582:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757589:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757595:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757634:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757641:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757647:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757653:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764774.757658:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757676:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757690:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:1.0:1775764774.757693:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.757698:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757703:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522edc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757720:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757920:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757926:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757932:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764774.757935:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757941:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757948:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0xeceaf236 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764774.757950:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.757953:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.757969:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ee3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.758000:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ed5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5054 expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.758010:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:1.0:1775764774.758012:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.758015:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522ed5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5054 expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.758025:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc 0) 00000100:00100000:1.0:1775764774.758084:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ffa26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:45627:x1862023076045184:12345-192.168.202.58@tcp:101:rm.0 Request processed in 676us (894us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764774.758092:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6340 00000040:00080000:0.0:1775764774.770208:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764774.770217:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764774.770747:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764774.770759:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1775764774.776311:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764774.792981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764774.793054:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045440 00000100:00100000:1.0:1775764774.793065:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045440 00000100:00100000:1.0:1775764774.793124:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6341 00000100:00100000:1.0:1775764774.793134:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+48:45628:x1862023076045440:12345-192.168.202.58@tcp:101:dd.0 00010000:00010000:1.0:1775764774.793156:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764774.793160:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1775764774.793187:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed522ece lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd504d expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793205:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:1.0:1775764774.793211:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764774.793238:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522eea lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd505b expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793342:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793356:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793368:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793383:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793390:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.793395:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764774.794100:0:24980:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x52:0x0], index 0: 0 00010000:00010000:1.0:1775764774.794300:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794312:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794322:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794360:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794382:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794388:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794395:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794402:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764774.794408:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794416:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794445:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:1.0:1775764774.794448:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764774.794468:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794475:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed522ef1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764774.794499:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aea0fa2b reply state 00000000d1cfda0f transno 4294970550 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794527:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794533:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0xeceaf236 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764774.794581:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764774.794586:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764774.794708:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed522eea lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764774.794765:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 49 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764774.795023:0:8640:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4aebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8640:1862023099782528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1775764774.795083:0:8640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764774.795129:0:8640:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1775764774.795198:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099782528 00000100:00100000:2.0:1775764774.795205:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099782528 00000100:00100000:2.0:1775764774.795256:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:2.0:1775764774.795266:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:8640:x1862023099782528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1775764774.795304:0:24969:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 98 00000100:00100000:3.0:1775764774.797414:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:8640:x1862023099782528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2143us (2324us total) trans 4294967714 rc 0/0 00000100:00100000:3.0:1775764774.797427:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00010000:00010000:1.0:1775764774.797472:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764774.797475:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764774.797480:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1200, rc 0) 00000100:00100000:1.0:1775764774.797542:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:45628:x1862023076045440:12345-192.168.202.58@tcp:101:dd.0 Request processed in 4408us (4570us total) trans 4294970550 rc 0/0 00000100:00100000:1.0:1775764774.797551:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6341 00000100:00100000:2.0:1775764774.798580:0:8640:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4aebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8640:1862023099782528:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1775764774.798595:0:8640:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x52:0x0]-[0x280000401:0x81:0x0] 00000100:00100000:2.0:1775764774.842103:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764774.842209:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045568 00000100:00100000:3.0:1775764774.842221:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045568 00000100:00100000:3.0:1775764774.842275:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1671 00000100:00100000:3.0:1775764774.842283:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ffa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1862023076045568:12345-192.168.202.58@tcp:8:dd.0 00010000:00080000:3.0:1775764774.842316:0:8402:0:(ldlm_lib.c:1429:target_handle_connect()) lustre-OST0000: connection from 2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp t0 exp 0000000000000000 cur 1282 last 0 00000020:00000080:3.0:1775764774.842349:0:8402:0:(genops.c:1404:class_connect()) connect: client 2bb64567-481f-43c2-999a-8c9c071338ae, cookie 0x6e98bd47ed522f0d 00002000:00100000:3.0:1775764774.842361:0:8402:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli 2bb64567-481f-43c2-999a-8c9c071338ae/ffff96c1c4dee000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211334c ocd_grant: 484638720 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1775764774.842372:0:8402:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1775764774.842432:0:8402:0:(ofd_obd.c:388:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1775764774.842462:0:8402:0:(import.c:65:import_set_state_nolock()) ffff96c1c4ded800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1775764774.842540:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ffa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2407:x1862023076045568:12345-192.168.202.58@tcp:8:dd.0 Request processed in 256us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764774.842548:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1671 00000100:00100000:0.0:1775764774.861129:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764774.861279:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045696 00000100:00100000:3.0:1775764774.861290:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045696 00000100:00100000:3.0:1775764774.861361:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1672 00000100:00100000:3.0:1775764774.861371:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:45628:x1862023076045696:12345-192.168.202.58@tcp:101:dd.0 00010000:00010000:3.0:1775764774.861388:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764774.861407:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5062 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764774.861433:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:1.0:1775764774.861493:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1775764774.861698:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764774.861701:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764774.861709:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.861880:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764774.861896:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764774.861962:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:45628:x1862023076045696:12345-192.168.202.58@tcp:101:dd.0 Request processed in 593us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764774.861970:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1672 00000100:00100000:0.0:1775764774.895008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764774.895188:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045824 00000100:00100000:3.0:1775764774.895199:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045824 00002000:00100000:3.0:1775764774.895249:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x52:0x0] (0->1048575) req@ffff96c1c67ac000 x1862023076045824/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:255/0 lens 488/0 e 0 to 0 dl 1775764785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764774.895260:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c67ac000 with x1862023076045824 ext(0->1048575) 00002000:00010000:3.0:1775764774.895266:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c67ac000 00000100:00100000:3.0:1775764774.895302:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 421 00000100:00100000:3.0:1775764774.895312:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076045824:12345-192.168.202.58@tcp:4:dd.0 00000040:00080000:0.0:1775764774.898637:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764774.898646:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764774.899274:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1775764774.899288:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:1.0:1775764774.966092:0:8398:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2bb64567-481f-43c2-999a-8c9c071338ae 00000001:00080000:1.0:1775764774.966111:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967714 is committed 00000100:00100000:0.0:1775764774.987162:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076045824:12345-192.168.202.58@tcp:4:dd.0 Request processed in 91830us (92143us total) trans 4294967715 rc 0/0 00000100:00100000:0.0:1775764774.987177:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 421 00002000:00100000:0.0:1775764774.987189:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x52:0x0] (0->1048575) req@ffff96c1c67ac000 x1862023076045824/t4294967715(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:255/0 lens 488/448 e 0 to 0 dl 1775764785 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764774.987200:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c67ac000 with x1862023076045824 ext(0->1048575) 00002000:00010000:0.0:1775764774.987207:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c67ac000 00000100:00100000:0.0:1775764775.004541:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.005830:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076045952 00000100:00100000:1.0:1775764775.005841:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076045952 00000100:00100000:1.0:1775764775.005921:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6342 00000100:00100000:1.0:1775764775.005932:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:45628:x1862023076045952:12345-192.168.202.58@tcp:44:dd.0 00000100:00080000:3.0:1775764775.006520:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1775764775.009065:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970550 is committed 00000001:00080000:1.0:1775764775.009090:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970549 is committed 00000100:00100000:3.0:1775764775.009411:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+47:45628:x1862023076045952:12345-192.168.202.58@tcp:44:dd.0 Request processed in 3475us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764775.009423:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6342 00010000:00010000:0.0:1775764775.009973:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.009986:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.009992:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.009998:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764775.010003:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010024:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010040:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac064746 (ffff96c1c2a03000) 00010000:00010000:0.0:1775764775.010043:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764775.010049:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010055:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522e8f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010076:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010081:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010087:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010092:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764775.010094:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010100:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010108:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c2a03400) 00010000:00010000:0.0:1775764775.010110:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764775.010113:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.010125:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522e96 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012384:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012399:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012406:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012411:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764775.012416:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012422:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012452:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0xeceaf236 (ffff96c2c7e0fa00) 00010000:00010000:2.0:1775764775.012455:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764775.012460:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.012466:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed522ef8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764775.014477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.015104:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046080 00000100:00100000:1.0:1775764775.015117:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046080 00000100:00100000:1.0:1775764775.015201:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1673 00000100:00100000:1.0:1775764775.015212:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076046080:12345-192.168.202.58@tcp:16:dd.0 00000001:00080000:0.0:1775764775.018711:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967715 is committed 00000100:00100000:1.0:1775764775.018907:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076046080:12345-192.168.202.58@tcp:16:dd.0 Request processed in 3690us (4432us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764775.018932:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1673 00000100:00100000:1.0:1775764775.024231:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764775.024402:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046336 00000100:00100000:3.0:1775764775.024413:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046336 00000100:00100000:3.0:1775764775.024485:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1327 00000100:00100000:3.0:1775764775.024495:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+46:45628:x1862023076046336:12345-192.168.202.58@tcp:35:dd.0 00000100:00100000:3.0:1775764775.026242:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+47:45628:x1862023076046336:12345-192.168.202.58@tcp:35:dd.0 Request processed in 1742us (2013us total) trans 4294970551 rc 0/0 00000100:00100000:3.0:1775764775.026256:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1327 00000100:00100000:0.0:1775764775.063747:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764775.063965:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046464 00000100:00100000:2.0:1775764775.063976:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046464 00000100:00100000:2.0:1775764775.064027:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6343 00000100:00100000:2.0:1775764775.064037:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+47:45629:x1862023076046464:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764775.064062:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764775.064081:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5069 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064144:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064170:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064188:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064202:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064209:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064229:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064324:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522f30 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064333:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522f30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064340:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522f30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764775.064374:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1775764775.064378:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764775.064411:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522f30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064425:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064431:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064437:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064444:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064449:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764775.064453:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064466:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064479:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764775.064482:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764775.064486:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064492:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed522f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064505:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064510:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064516:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064521:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764775.064524:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064529:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064536:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac064746 (ffff96c1c4135000) 00010000:00010000:2.0:1775764775.064538:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764775.064540:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064554:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed522f29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064581:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed522f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5069 expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064593:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0e00/0x6e98bd47ed522f30 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5069 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764775.064601:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:2.0:1775764775.064603:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764775.064605:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0e00, rc 0) 00000100:00100000:2.0:1775764775.064669:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:45629:x1862023076046464:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 634us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764775.064677:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6343 00000100:00100000:0.0:1775764775.102032:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.102138:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046592 00000100:00100000:1.0:1775764775.102159:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046592 00000100:00100000:1.0:1775764775.102240:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6344 00000100:00100000:1.0:1775764775.102250:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c4fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+18:45631:x1862023076046592:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764775.102278:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764775.102301:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed522f37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5070 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1775764775.102359:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1775764775.102369:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed522f3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.102384:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed522f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.102396:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed522f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764775.102438:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764775.102442:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764775.102462:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed522f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.102485:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed522f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5070 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.102504:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed522f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5070 expref: 19 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.102537:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764775.102539:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764775.102544:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0000, rc 0) 00000100:00100000:1.0:1775764775.102613:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c4fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:45631:x1862023076046592:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 364us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764775.102620:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6344 00000100:00100000:3.0:1775764775.134400:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.134603:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046720 00000100:00100000:1.0:1775764775.134614:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046720 00000100:00100000:1.0:1775764775.134731:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6345 00000100:00100000:1.0:1775764775.134742:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+19:45631:x1862023076046720:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764775.134764:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764775.134819:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed522f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5077 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.134904:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.134919:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.134930:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.134944:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.134951:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.134990:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.135093:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522f5a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.135112:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522f5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.135120:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522f5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764775.135160:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1775764775.135164:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764775.136319:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522f5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136340:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136347:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136353:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136360:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136366:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764775.136371:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136392:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136405:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764775.136408:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764775.136413:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136419:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0400/0x6e98bd47ed522f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136433:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136439:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136445:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136451:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764775.136454:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136459:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136466:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac064746 (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764775.136468:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764775.136472:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136488:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xac064746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136526:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed522f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5077 expref: 21 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136540:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0200/0x6e98bd47ed522f5a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5077 expref: 20 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.136547:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:1.0:1775764775.136550:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1775764775.136552:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0200, rc 0) 00000100:00100000:1.0:1775764775.136619:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:45631:x1862023076046720:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1879us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764775.136628:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6345 00000100:00100000:3.0:1775764775.141187:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764775.176672:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046848 00000100:00100000:0.0:1775764775.176688:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046848 00000100:00100000:3.0:1775764775.176919:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6346 00000100:00100000:3.0:1775764775.176930:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:45631:x1862023076046848:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764775.176951:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764775.176982:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522f61 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd507e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177070:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177085:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177110:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177127:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177134:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177141:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177542:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177552:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177559:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764775.177594:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00000004:00200000:3.0:1775764775.177598:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764775.177618:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177628:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177637:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177642:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177648:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177655:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177661:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764775.177665:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177680:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177695:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:3.0:1775764775.177698:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764775.177704:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177711:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522f68 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177725:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177731:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177738:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177742:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764775.177745:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177751:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177758:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0xeceaf236 (ffff96c1c2a03600) 00010000:00010000:3.0:1775764775.177760:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764775.177763:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177805:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f6f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177839:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed522f61 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177869:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.177877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:3.0:1775764775.177880:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764775.177882:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9600, rc 0) 00000100:00100000:3.0:1775764775.177952:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:45631:x1862023076046848:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1023us (36775us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764775.177961:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6346 00000100:00100000:2.0:1775764775.190610:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764775.190690:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076046976 00000100:00100000:3.0:1775764775.190700:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076046976 00000100:00100000:3.0:1775764775.190816:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1674 00000100:00100000:3.0:1775764775.190829:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ffa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076046976:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764775.190865:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764775.190883:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522f7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5085 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764775.190950:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099782656:192.168.202.58@tcp:106: 00000100:00100000:3.0:1775764775.191058:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c5655cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1775764775.192414:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1775764775.195999:0:8402:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:1.0:1775764775.196009:0:8402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb mtime: 0 -> 1775764774 00002000:00010000:1.0:1775764775.196012:0:8402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb atime: 0 -> 1775764774 00002000:00010000:1.0:1775764775.196014:0:8402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb ctime: 0 -> 1775764774 00002000:00010000:1.0:1775764775.196016:0:8402:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x52:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:1.0:1775764775.196045:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099782656:192.168.202.58@tcp:106: 00010000:00010000:1.0:1775764775.196090:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522f7d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5085 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.196130:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f09f6ae2/0x6e98bd47ed522f7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5085 expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.196166:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8400, rc 0) 00000100:00100000:1.0:1775764775.196245:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ffa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076046976:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 5418us (5645us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764775.196255:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1674 00000100:00100000:2.0:1775764775.222540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.222861:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076047104 00000100:00100000:1.0:1775764775.222872:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076047104 00000100:00100000:1.0:1775764775.222934:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6347 00000100:00100000:1.0:1775764775.222946:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ffa26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:45631:x1862023076047104:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764775.222966:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764775.222998:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed522f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd508c expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.223077:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.223092:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.223121:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764775.223174:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1775764775.223178:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764775.223198:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.223224:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed522f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 23 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.223262:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 22 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.223272:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:1.0:1775764775.223274:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764775.223278:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1600, rc 0) 00000100:00100000:1.0:1775764775.223340:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ffa26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:45631:x1862023076047104:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 397us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764775.223348:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6347 00000100:00100000:2.0:1775764775.236092:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.236203:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076047232 00000100:00100000:1.0:1775764775.236214:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076047232 00000100:00100000:1.0:1775764775.236273:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1675 00000100:00100000:1.0:1775764775.236285:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076047232:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764775.236305:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764775.236324:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e3a4f59/0x6e98bd47ed522f92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5093 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764775.236388:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4c96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099782784:192.168.202.58@tcp:106: 00000100:00100000:1.0:1775764775.236472:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1775764775.255952:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4c96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099782784:192.168.202.58@tcp:106: 00010000:00010000:1.0:1775764775.256006:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e3a4f59/0x6e98bd47ed522f92 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5093 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.256036:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e3a4f59/0x6e98bd47ed522f92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5093 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764775.256064:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0e00, rc 0) 00000100:00100000:1.0:1775764775.256125:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076047232:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 19843us (20043us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764775.256135:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1675 00000100:00100000:2.0:1775764775.303113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764775.303253:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076047488 00000100:00100000:1.0:1775764775.303263:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076047488 00000100:00100000:1.0:1775764775.303323:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6348 00000100:00100000:1.0:1775764775.303333:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:45631:x1862023076047488:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:1.0:1775764775.303902:0:10681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].145, 136 off27704 00000100:00100000:1.0:1775764775.304004:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:45631:x1862023076047488:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 672us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764775.304013:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6348 00000100:00100000:0.0:1775764775.730180:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099782912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764775.730251:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764775.730434:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099782912 00000100:00100000:3.0:1775764775.730456:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099782912 00000100:00100000:3.0:1775764775.730507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1775764775.730516:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c4fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099782912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764775.730549:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444245504 avail 1298006016 00000100:00100000:3.0:1775764775.730606:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c4fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099782912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764775.730614:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1775764775.730861:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099782912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764775.797841:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764775.926201:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764775.926210:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764775.926314:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 146 count 2 00000040:00080000:2.0:1775764775.926321:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764775.926589:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c74e4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099783040:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764775.926694:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa06840 going to sleep for 11 seconds 00000100:00100000:3.0:1775764775.938334:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c74e4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099783040:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764775.947604:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764775.947664:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076047616 00000100:00100000:2.0:1775764775.947674:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076047616 00000100:00100000:2.0:1775764775.947728:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6349 00000100:00100000:2.0:1775764775.947738:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:45641:x1862023076047616:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764775.947789:0:6523:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x99:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1775764775.947926:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:45641:x1862023076047616:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 189us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764775.947935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6349 00000100:00100000:3.0:1775764775.961898:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764775.961928:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076047872 00000100:00100000:3.0:1775764775.961937:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076047872 00000100:00100000:3.0:1775764775.961981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6350 00000100:00100000:3.0:1775764775.961989:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+48:45641:x1862023076047872:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764775.962022:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764775.962040:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd509a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.962149:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522fa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.962162:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.962174:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764775.962184:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00010000:00010000:3.0:1775764775.962276:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed522f99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd509a expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.962304:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd509a expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.962313:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:3.0:1775764775.962316:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764775.962320:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9400, rc 0) 00000100:00100000:3.0:1775764775.962368:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076047872:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 379us (478us total) trans 4294970552 rc 0/0 00000100:00100000:3.0:1775764775.962375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6350 00000100:00100000:3.0:1775764775.966487:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764775.966539:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764775.966572:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076048000 00000100:00100000:3.0:1775764775.966583:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076048000 00000100:00100000:3.0:1775764775.966635:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1676 00000100:00100000:3.0:1775764775.966645:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076048000:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764775.966692:0:24969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.966714:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 6 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.966723:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764775.966725:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764775.966729:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 4/1,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.966803:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 6 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.966819:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 6 pid: 15167 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764775.966837:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099783168:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764775.966927:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c84146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764775.966946:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076048128 00000100:00100000:3.0:1775764775.966950:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076048128 00000100:00100000:3.0:1775764775.966986:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 738 00000100:00100000:3.0:1775764775.966993:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:2411:x1862023076048128:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764775.967005:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764775.967443:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed522fa0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd509a expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.967464:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:3.0:1775764775.967469:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764775.967500:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+49:2411:x1862023076048128:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 507us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764775.967508:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 738 00000100:00100000:3.0:1775764775.977732:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764775.977798:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076048256 00000100:00100000:3.0:1775764775.977808:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076048256 00010000:00010000:3.0:1775764775.977881:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 7 pid: 15167 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764775.977921:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1368 00000100:00100000:3.0:1775764775.977930:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076048256:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764775.977948:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764775.977968:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 7 pid: 15167 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.977983:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 7 pid: 15167 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.978010:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764775.978012:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764775.978018:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.978028:0:6505:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764775.978050:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764775.978098:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076048256:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 168us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764775.978105:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1368 00010000:00010000:0.0:1775764775.978430:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed522f14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5062 expref: 6 pid: 15167 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764775.978445:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7170e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099783168:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764775.978477:0:24969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978488:0:24969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978495:0:24969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978530:0:24969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978538:0:24969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978546:0:24969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978553:0:24969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764775.978558:0:24969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978566:0:24969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978578:0:24969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764775.978586:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8f7dc5/0x6e98bd47ed522fae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764775.978639:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076048000:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 11996us (12163us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764775.978658:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1676 00000100:00100000:1.0:1775764775.990249:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764775.990347:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076048512 00000100:00100000:2.0:1775764775.990359:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076048512 00000100:00100000:2.0:1775764775.990426:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6351 00000100:00100000:2.0:1775764775.990437:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:45641:x1862023076048512:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1775764775.990566:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:45641:x1862023076048512:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 130us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764775.990575:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6351 00000100:00100000:0.0:1775764776.003359:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.004017:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076048640 00000100:00100000:3.0:1775764776.004029:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076048640 00000100:00100000:3.0:1775764776.004112:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1677 00000100:00100000:3.0:1775764776.004124:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2410:x1862023076048640:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764776.004154:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764776.004239:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50a1 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764776.004267:0:8641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x52:0x0] initial LVB size: 1048576, mtime: 0x69d80526, atime: 0x0, ctime: 0x69d80526, blocks: 0x800 00010000:00010000:3.0:1775764776.004288:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764776.004291:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764776.004300:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 6 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.004319:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 6 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.004334:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764776.004398:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076048640:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 277us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.004406:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1677 00000100:00080000:0.0:1775764776.005026:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764776.019142:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.019309:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076048896 00000100:00100000:3.0:1775764776.019321:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076048896 00000100:00100000:3.0:1775764776.019380:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6352 00000100:00100000:3.0:1775764776.019390:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:45641:x1862023076048896:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764776.019517:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:45641:x1862023076048896:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 128us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.019525:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6352 00000100:00100000:1.0:1775764776.031150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764776.031636:0:8410:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076049024 00000100:00100000:0.0:1775764776.031647:0:8410:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076049024 00002000:00100000:0.0:1775764776.031701:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x52:0x0] (0->1048575) req@ffff96c1c4d34a80 x1862023076049024/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:257/0 lens 488/0 e 0 to 0 dl 1775764787 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764776.031711:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4d34a80 with x1862023076049024 ext(0->1048575) 00002000:00010000:0.0:1775764776.031717:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c4d34a80 00000100:00100000:0.0:1775764776.031751:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 422 00000100:00100000:0.0:1775764776.031761:0:8410:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076049024:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1775764776.082402:0:8410:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076049024:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 50628us (51622us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1775764776.082418:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 422 00002000:00100000:0.0:1775764776.082440:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x52:0x0] (0->1048575) req@ffff96c1c4d34a80 x1862023076049024/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:257/0 lens 488/440 e 0 to 0 dl 1775764787 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764776.082450:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4d34a80 with x1862023076049024 ext(0->1048575) 00002000:00010000:0.0:1775764776.082457:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c4d34a80 00000100:00100000:1.0:1775764776.106915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.107005:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076049152 00000100:00100000:3.0:1775764776.107028:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076049152 00000100:00100000:3.0:1775764776.107100:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6353 00000100:00100000:3.0:1775764776.107109:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+49:45641:x1862023076049152:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764776.107131:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764776.107161:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522fbc lrc: 2/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50a8 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.107193:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.107207:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.107219:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.107322:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed522fbc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.107342:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.107350:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:3.0:1775764776.107353:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764776.107357:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9000, rc 0) 00000100:00100000:3.0:1775764776.107823:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076049152:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 713us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.107833:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6353 00000100:00100000:0.0:1775764776.117940:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.118039:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076049280 00000100:00100000:3.0:1775764776.118050:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076049280 00000100:00100000:3.0:1775764776.118130:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6354 00000100:00100000:3.0:1775764776.118140:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076049280:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764776.118181:0:14288:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x99:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764776.118307:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076049280:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 169us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.118315:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6354 00000100:00100000:0.0:1775764776.121095:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.121182:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076049408 00000100:00100000:3.0:1775764776.121195:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076049408 00000100:00100000:3.0:1775764776.121257:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1678 00000100:00100000:3.0:1775764776.121268:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076049408:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764776.121315:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121332:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764776.121334:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764776.121339:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121353:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121377:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121384:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121407:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121413:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764776.121417:0:15167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121425:0:15167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121441:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.121448:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed522fca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.121524:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076049408:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 258us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.121532:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1678 00000100:00100000:1.0:1775764776.126301:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.127290:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076049664 00000100:00100000:3.0:1775764776.127302:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076049664 00000100:00100000:3.0:1775764776.127375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6355 00000100:00100000:3.0:1775764776.127386:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076049664:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764776.127461:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.127553:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.127563:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.127684:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.127697:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 50 pid: 24980 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.127712:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099783296:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764776.127883:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2dfee1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1775764776.131194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.131250:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099783296:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764776.131277:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.133933:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076049792 00000100:00100000:0.0:1775764776.133946:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076049792 00010000:00010000:0.0:1775764776.133985:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 51 pid: 24980 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.134036:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1369 00000100:00100000:0.0:1775764776.134046:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076049792:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764776.134062:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764776.134069:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 51 pid: 24980 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134082:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 51 pid: 24980 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134103:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed522fc3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a8 expref: 51 pid: 24980 timeout: 1383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134118:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764776.134123:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134132:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134141:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134168:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764776.134224:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+50:2411:x1862023076049792:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 179us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764776.134232:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1369 00010000:00010000:0.0:1775764776.134414:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134428:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134578:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134586:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134593:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134599:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764776.134604:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134611:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134620:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764776.134623:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764776.134626:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.134632:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed522fd1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.134720:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076049664:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 7335us (8428us total) trans 4294970553 rc 0/0 00000100:00100000:0.0:1775764776.134728:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6355 00000040:00080000:0.0:1775764776.134872:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764776.134877:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764776.135358:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1775764776.135367:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764776.140511:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764776.140652:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076050048 00000100:00100000:0.0:1775764776.140663:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076050048 00000100:00100000:0.0:1775764776.140722:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1328 00000100:00100000:0.0:1775764776.140732:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:45641:x1862023076050048:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1775764776.140976:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:45641:x1862023076050048:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 245us (473us total) trans 4294970554 rc 0/0 00000100:00100000:0.0:1775764776.140985:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1328 00000040:00080000:2.0:1775764776.259481:0:29675:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764776.259490:0:29675:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764776.259562:0:29675:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 146 count 2 00000040:00080000:2.0:1775764776.259574:0:29675:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764776.371522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764776.371622:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076050176 00000100:00100000:1.0:1775764776.371632:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076050176 00000100:00100000:1.0:1775764776.371679:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1679 00000100:00100000:1.0:1775764776.371688:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2409:x1862023076050176:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764776.371703:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764776.371720:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50af expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.371789:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764776.371792:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764776.371800:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.371819:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.371833:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4800, rc 0) 00000100:00100000:1.0:1775764776.371891:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076050176:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 205us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764776.371899:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1679 00000100:00100000:0.0:1775764776.390128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764776.390209:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076050432 00000100:00100000:1.0:1775764776.390219:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076050432 00000100:00100000:1.0:1775764776.390277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6356 00000100:00100000:1.0:1775764776.390287:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:45642:x1862023076050432:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764776.390308:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764776.390329:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed522fdf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.390433:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed522fe6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.390448:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed522fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.390462:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed522fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764776.390483:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00010000:00010000:1.0:1775764776.390576:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed522fdf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50b6 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.390594:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed522fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50b6 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.390615:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764776.390618:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1775764776.390622:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5800, rc 0) 00000100:00100000:1.0:1775764776.390680:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:45642:x1862023076050432:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 395us (560us total) trans 4294970555 rc 0/0 00000100:00100000:1.0:1775764776.390688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6356 00000100:00100000:1.0:1775764776.400889:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764776.401006:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076050560 00000100:00100000:0.0:1775764776.401020:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076050560 00000100:00100000:0.0:1775764776.401102:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1680 00000100:00100000:0.0:1775764776.401115:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076050560:12345-192.168.202.58@tcp:1:lfs.0 00010000:00010000:0.0:1775764776.401181:0:8641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.401207:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 5 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.401217:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.401225:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764776.401244:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764776.401248:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.401293:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.401309:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 7 pid: 8403 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.401326:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f7288e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099783424:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764776.401433:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 5 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.401443:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 5 pid: 8641 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.401455:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f728b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099783552:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764776.401482:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c56553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764776.409068:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f7288e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099783424:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764776.409098:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f728b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099783552:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764776.409126:0:8641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764776.411888:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.412921:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076050688 00000100:00100000:3.0:1775764776.412933:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076050688 00010000:00010000:3.0:1775764776.412977:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 8 pid: 8403 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.413031:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1370 00000100:00100000:3.0:1775764776.413041:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076050688:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764776.413073:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764776.413107:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 8 pid: 8403 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.413122:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 8 pid: 8403 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.413152:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e04f1d71/0x6e98bd47ed522fd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50af expref: 8 pid: 8403 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.413171:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764776.413223:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076050688:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 184us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.413232:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1370 00000100:00100000:0.0:1775764776.414653:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.415021:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076050816 00000100:00100000:3.0:1775764776.415029:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076050816 00010000:00010000:3.0:1775764776.415063:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 6 pid: 8641 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.415104:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1371 00000100:00100000:3.0:1775764776.415113:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076050816:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764776.415126:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764776.415152:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 6 pid: 8641 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.415180:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 6 pid: 8641 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.415201:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed522fb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50a1 expref: 6 pid: 8641 timeout: 1384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.415214:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764776.415216:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764776.415221:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.415232:0:25199:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.415299:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764776.415348:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+5:2410:x1862023076050816:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 236us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.415356:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1371 00010000:00010000:2.0:1775764776.420670:0:8641:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420688:0:8641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420720:0:8641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420737:0:8641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420746:0:8641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420753:0:8641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764776.420808:0:8641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420818:0:8641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420850:0:8641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.420857:0:8641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed522ff4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.422078:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076050560:12345-192.168.202.58@tcp:1:lfs.0 Request processed in 20957us (21188us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.422090:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1680 00000100:00100000:3.0:1775764776.425092:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764776.425184:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076051072 00000100:00100000:1.0:1775764776.425195:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076051072 00000100:00100000:1.0:1775764776.425252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1329 00000100:00100000:1.0:1775764776.425262:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dd67f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:45642:x1862023076051072:12345-192.168.202.58@tcp:35:lfs.0 00000004:00010000:1.0:1775764776.425327:0:6525:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x200000403:0x99:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed522fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50b6 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1775764776.425528:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970556 00000001:00080000:1.0:1775764776.426496:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970557 00010000:00010000:1.0:1775764776.426543:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.426573:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.426581:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.426589:0:6525:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 5/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.427065:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.427081:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 27 pid: 6522 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764776.427098:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d34e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099783680:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764776.427323:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.427334:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 50 pid: 24980 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764776.427359:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d34380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099783808:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764776.427387:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1775764776.438071:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764776.438109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764776.438183:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076051328 00000100:00100000:0.0:1775764776.438194:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076051328 00010000:00010000:0.0:1775764776.438234:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 51 pid: 24980 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.438272:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076051200 00000100:00100000:0.0:1775764776.438275:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076051200 00010000:00010000:0.0:1775764776.438303:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 28 pid: 6522 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.438330:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1372 00000100:00100000:0.0:1775764776.438339:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+51:2410:x1862023076051328:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764776.438356:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764776.438364:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 51 pid: 24980 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438376:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 51 pid: 24980 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438401:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764776.438406:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438415:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438423:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764776.438478:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+51:2410:x1862023076051328:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 139us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764776.438485:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1372 00000100:00100000:0.0:1775764776.438501:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1373 00000100:00100000:0.0:1775764776.438508:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:2410:x1862023076051200:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764776.438515:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764776.438520:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 28 pid: 6522 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438536:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 28 pid: 6522 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438548:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764776.438551:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438559:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438566:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.438585:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764776.438603:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:2410:x1862023076051200:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 95us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764776.438610:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1373 00010000:00010000:3.0:1775764776.439205:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed522f76 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd507e expref: 27 pid: 6522 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.439237:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d34e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099783680:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764776.439253:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1200/0x6e98bd47ed522eff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd505b expref: 50 pid: 24980 timeout: 1384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764776.439263:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d34380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099783808:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764776.439284:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.439293:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.439298:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1775764776.439415:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970558 00000001:00080000:3.0:1775764776.439523:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970559 00000100:00100000:3.0:1775764776.439624:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff821f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099783936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1775764776.439677:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764776.439711:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c3a5d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764776.439824:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099783936 00000100:00100000:0.0:1775764776.439829:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099783936 00000100:00100000:0.0:1775764776.439885:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1775764776.439892:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099783936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764776.439971:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099783936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764776.439977:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1775764776.440017:0:6525:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967714 gen 2 00000100:00100000:0.0:1775764776.440029:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff821f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099783936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1775764776.440132:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970560 00000100:00100000:0.0:1775764776.440183:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f728b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099784064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764776.440209:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764776.440233:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2dfee1180 going to sleep for 11 seconds 00000100:00100000:0.0:1775764776.440246:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099784064 00000100:00100000:0.0:1775764776.440250:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099784064 00000100:00100000:0.0:1775764776.440272:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1775764776.440277:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099784064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764776.440372:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1862023099784064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (162us total) trans 4294967716 rc 0/0 00000100:00100000:0.0:1775764776.440379:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1775764776.440409:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f728b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099784064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1775764776.440438:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970561 00010000:00010000:0.0:1775764776.440459:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.440467:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.440473:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.440478:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764776.440483:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.440490:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.440508:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764776.440518:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1775764776.440524:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764776.440529:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed522ffb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1775764776.440615:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000405:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1775764776.440671:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].66, 64 off13256 00000004:00080000:0.0:1775764776.440682:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1284261910523ns, next at 1285261909020ns, rc = 0 00000001:00080000:0.0:1775764776.440688:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970562 00010000:00010000:0.0:1775764776.440708:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764776.440711:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1775764776.440717:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed522fe6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50b6 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764776.440853:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dd67f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:45642:x1862023076051072:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 15593us (15771us total) trans 4294970563 rc 0/0 00000100:00100000:0.0:1775764776.440862:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1329 00000020:00080000:0.0:1775764776.440866:0:6525:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00080000:3.0:1775764776.441591:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764776.492500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764776.495041:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076051584 00000100:00100000:2.0:1775764776.495058:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076051584 00000100:00100000:2.0:1775764776.495175:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6357 00000100:00100000:2.0:1775764776.495186:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:45643:x1862023076051584:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764776.495212:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764776.495233:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523002 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50bd expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495321:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495335:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495347:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495360:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495367:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495373:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495482:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed523017 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495490:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed523017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495497:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed523017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764776.495508:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00010000:00010000:2.0:1775764776.495586:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495602:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495608:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495615:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495619:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764776.495623:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495630:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495642:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:2.0:1775764776.495645:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764776.495649:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495654:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523009 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495666:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495672:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495678:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495688:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764776.495691:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495697:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495704:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0xeceaf236 (ffff96c1c4135300) 00010000:00010000:2.0:1775764776.495706:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764776.495708:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495714:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523010 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0xeceaf236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495795:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523002 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50bd expref: 33 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495809:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed523017 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50bd expref: 32 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.495816:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c4135900) 00010000:00010000:2.0:1775764776.495818:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764776.495820:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0c00, rc 0) 00000100:00100000:2.0:1775764776.495903:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:45643:x1862023076051584:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 719us (3414us total) trans 4294970564 rc 0/0 00000100:00100000:2.0:1775764776.495911:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6357 00000100:00100000:0.0:1775764776.505384:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764776.505468:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076051712 00000100:00100000:2.0:1775764776.505486:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076051712 00000100:00100000:2.0:1775764776.505551:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6358 00000100:00100000:2.0:1775764776.505561:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:45643:x1862023076051712:12345-192.168.202.58@tcp:54:lfs.0 00010000:00010000:2.0:1775764776.505634:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505651:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505666:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505701:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505708:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505715:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505722:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764776.505726:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505734:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505747:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c4135900) 00010000:00010000:2.0:1775764776.505751:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764776.505756:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.505874:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523025 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764776.505949:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:45643:x1862023076051712:12345-192.168.202.58@tcp:54:lfs.0 Request processed in 388us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764776.505957:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6358 00000100:00100000:3.0:1775764776.509174:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764776.510278:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076051968 00000100:00100000:2.0:1775764776.510293:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076051968 00000100:00100000:2.0:1775764776.510355:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1330 00000100:00100000:2.0:1775764776.510365:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:45643:x1862023076051968:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:2.0:1775764776.510587:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:45643:x1862023076051968:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 223us (1423us total) trans 4294970565 rc 0/0 00000100:00100000:2.0:1775764776.510595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1330 00000100:00100000:3.0:1775764776.564623:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764776.568151:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076052224 00000100:00100000:1.0:1775764776.568166:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076052224 00000100:00100000:1.0:1775764776.568236:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6359 00000100:00100000:1.0:1775764776.568248:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:45645:x1862023076052224:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:1.0:1775764776.568276:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764776.568301:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52302c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764776.568406:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1775764776.568539:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52302c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50c4 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.568555:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764776.568558:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1775764776.568563:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52302c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50c4 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764776.568574:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5800, rc 0) 00000100:00100000:1.0:1775764776.568640:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:45645:x1862023076052224:12345-192.168.202.58@tcp:101:tar.0 Request processed in 394us (4026us total) trans 4294970566 rc 301/301 00000100:00100000:1.0:1775764776.568667:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6359 00000100:00100000:3.0:1775764776.576494:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764776.579242:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076052352 00000100:00100000:0.0:1775764776.579257:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076052352 00000100:00100000:0.0:1775764776.579342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1331 00000100:00100000:0.0:1775764776.579352:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:45645:x1862023076052352:12345-192.168.202.58@tcp:37:tar.0 00000100:00100000:0.0:1775764776.584171:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:45645:x1862023076052352:12345-192.168.202.58@tcp:37:tar.0 Request processed in 4804us (7671us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764776.584186:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1331 00000100:00100000:2.0:1775764776.600060:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764776.600103:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076052608 00000100:00100000:2.0:1775764776.600114:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076052608 00000100:00100000:2.0:1775764776.600170:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6360 00000100:00100000:2.0:1775764776.600180:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:45645:x1862023076052608:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:2.0:1775764776.600207:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764776.600228:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52303a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50cb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.600339:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523041 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.600355:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523041 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x99:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.600381:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523041 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x99:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764776.600394:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00010000:00010000:2.0:1775764776.600516:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52303a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50cb expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.600535:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523041 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x99:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50cb expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764776.600546:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c4135900) 00010000:00010000:2.0:1775764776.600549:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1775764776.600553:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1200, rc 0) 00000100:00100000:2.0:1775764776.600615:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:45645:x1862023076052608:12345-192.168.202.58@tcp:101:tar.0 Request processed in 436us (566us total) trans 4294970567 rc 0/0 00000100:00100000:2.0:1775764776.600622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6360 00000100:00100000:3.0:1775764776.609507:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764776.609694:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076052864 00000100:00100000:0.0:1775764776.609706:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076052864 00000100:00100000:3.0:1775764776.609806:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 739 00000100:00100000:3.0:1775764776.609817:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:45645:x1862023076052864:12345-192.168.202.58@tcp:103:tar.0 00010000:00010000:3.0:1775764776.609856:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1775764776.609884:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523041 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50cb expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.609906:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed523017 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50bd expref: 35 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.609917:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c4135900) 00010000:00010000:3.0:1775764776.609929:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764776.610203:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:45645:x1862023076052864:12345-192.168.202.58@tcp:103:tar.0 Request processed in 387us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764776.612795:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.613331:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076052992 00000100:00100000:3.0:1775764776.613341:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076052992 00000100:00100000:3.0:1775764776.613397:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6361 00000100:00100000:3.0:1775764776.613406:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:45645:x1862023076052992:12345-192.168.202.58@tcp:58:tar.0 00010000:00010000:3.0:1775764776.613513:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.613530:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.613541:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1775764776.613739:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].146, 136 off27840 00000100:00100000:3.0:1775764776.614021:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:45645:x1862023076052992:12345-192.168.202.58@tcp:58:tar.0 Request processed in 614us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.614029:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6361 00000100:00100000:1.0:1775764776.615235:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 739 00000100:00100000:2.0:1775764776.616868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764776.616931:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076053120 00000100:00100000:3.0:1775764776.616942:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076053120 00000100:00100000:3.0:1775764776.617013:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6362 00000100:00100000:3.0:1775764776.617023:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:45645:x1862023076053120:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764776.617044:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764776.617063:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50d2 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.617114:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.617125:0:10681:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 35 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.617153:0:10681:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.617165:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 35 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.617178:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:3.0:1775764776.617182:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1775764776.617186:0:10681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 35 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764776.617194:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9400, rc 0) 00000100:00100000:3.0:1775764776.617243:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:45645:x1862023076053120:12345-192.168.202.58@tcp:101:tar.0 Request processed in 222us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764776.617249:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6362 00000100:00100000:0.0:1775764776.754112:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775764776.754137:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099784192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764776.754215:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764776.754381:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099784192 00000100:00100000:2.0:1775764776.754390:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099784192 00000100:00100000:2.0:1775764776.754437:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1775764776.754446:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099784192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1775764776.754474:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 24514752 pending 0 free 3915911168 avail 3684388864 00000100:00100000:2.0:1775764776.754528:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099784192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764776.754535:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1775764776.754656:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099784192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764776.755360:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099784320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764776.755404:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764776.755485:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099784320 00000100:00100000:0.0:1775764776.755490:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099784320 00000100:00100000:0.0:1775764776.755548:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1775764776.755557:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099784320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1775764776.755572:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 24514752 pending 0 free 3915911168 avail 3684388864 00000100:00100000:0.0:1775764776.755616:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099784320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764776.755624:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00080000:3.0:1775764776.755822:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764776.755905:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099784320:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1775764776.818973:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764777.142473:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764777.142482:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764777.142552:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 147 count 3 00000040:00080000:0.0:1775764777.142564:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764777.142729:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099784448:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1775764777.142880:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2dfee1180 going to sleep for 11 seconds 00000100:00100000:2.0:1775764777.151324:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.151426:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076053248 00000100:00100000:1.0:1775764777.151437:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076053248 00000100:00100000:1.0:1775764777.151513:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6363 00000100:00100000:1.0:1775764777.151526:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:45648:x1862023076053248:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764777.151643:0:6523:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x99:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764777.151760:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:45648:x1862023076053248:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 236us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.151767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6363 00000100:00080000:3.0:1775764777.152133:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764777.152348:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099784448:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764777.160410:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.160512:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076053376 00000100:00100000:1.0:1775764777.160531:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076053376 00000100:00100000:1.0:1775764777.160603:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6364 00000100:00100000:1.0:1775764777.160614:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+50:45648:x1862023076053376:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1775764777.160692:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160712:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160737:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160826:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160846:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160854:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160882:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160890:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160897:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764777.160945:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00000004:00200000:1.0:1775764777.160950:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764777.160964:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160976:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160983:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.160990:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161006:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764777.161010:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161018:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161029:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:1.0:1775764777.161032:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764777.161036:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161043:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52305d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161057:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161063:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161068:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161073:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764777.161076:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161082:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161099:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x35d3ac89 (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764777.161101:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764777.161104:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161109:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523064 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x35d3ac89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161123:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161128:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161132:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161136:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764777.161138:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161143:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161150:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:1.0:1775764777.161152:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764777.161154:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.161159:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed52306b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764777.161259:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+50:45648:x1862023076053376:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 Request processed in 646us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.161268:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6364 00000100:00100000:2.0:1775764777.175294:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.176361:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076053632 00000100:00100000:3.0:1775764777.176376:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076053632 00000100:00100000:3.0:1775764777.176457:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6365 00000100:00100000:3.0:1775764777.176468:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:45648:x1862023076053632:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764777.176489:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764777.176510:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523072 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50d9 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177051:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177070:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177081:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764777.177092:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00010000:00010000:3.0:1775764777.177180:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177188:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177195:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177201:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764777.177205:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177231:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177243:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:3.0:1775764777.177246:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764777.177250:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177255:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523079 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177298:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523072 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d9 expref: 52 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177309:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764777.177311:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1775764777.177315:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523072 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d9 expref: 52 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.177325:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764777.177459:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+51:45648:x1862023076053632:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 992us (2173us total) trans 4294970568 rc 301/301 00000100:00100000:3.0:1775764777.177467:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6365 00000100:00100000:3.0:1775764777.186954:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.187147:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076053760 00000100:00100000:1.0:1775764777.187161:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076053760 00000100:00100000:1.0:1775764777.187234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6366 00000100:00100000:1.0:1775764777.187245:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+51:45648:x1862023076053760:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764777.187293:0:6522:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x99:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764777.187421:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+51:45648:x1862023076053760:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 178us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.187429:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6366 00000100:00100000:2.0:1775764777.193332:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.193505:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076054016 00000100:00100000:3.0:1775764777.193514:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076054016 00000100:00100000:3.0:1775764777.193580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6367 00000100:00100000:3.0:1775764777.193590:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:45648:x1862023076054016:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764777.193625:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764777.193644:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523087 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50e0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.194436:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52308e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.194451:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52308e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.194465:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52308e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764777.194475:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9a:0x0]: returning size 0 00010000:00010000:3.0:1775764777.194520:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523087 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e0 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.194538:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52308e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e0 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.194547:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03500) 00010000:00010000:3.0:1775764777.194549:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764777.194553:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764777.194673:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+53:45648:x1862023076054016:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1084us (1349us total) trans 4294970569 rc 0/0 00000100:00100000:3.0:1775764777.194682:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6367 00000100:00100000:3.0:1775764777.201990:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764777.202207:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076054272 00000100:00100000:2.0:1775764777.202217:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076054272 00000100:00100000:2.0:1775764777.202332:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6368 00000100:00100000:2.0:1775764777.202344:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+53:45648:x1862023076054272:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1775764777.202411:0:10088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764777.202442:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52308e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e0 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.202461:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03500) 00010000:00010000:2.0:1775764777.202487:0:10088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764777.202507:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.202521:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 34 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.202540:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 4/0,1 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.202574:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 34 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.202587:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 34 pid: 14288 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764777.202622:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2dfc4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099784576:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764777.202846:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c4ff2240 going to sleep for 11 seconds 00000100:00100000:3.0:1775764777.206342:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2dfc4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099784576:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764777.206396:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.208497:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.208570:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076054400 00000100:00100000:0.0:1775764777.208581:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076054400 00010000:00010000:0.0:1775764777.208662:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 35 pid: 14288 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.208721:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1374 00000100:00100000:0.0:1775764777.208731:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:2411:x1862023076054400:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764777.208757:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764777.208766:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 35 pid: 14288 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.208804:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 35 pid: 14288 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.208869:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1600/0x6e98bd47ed522f8b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd508c expref: 35 pid: 14288 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.208900:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:0.0:1775764777.208907:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.208917:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.208925:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.208950:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764777.208968:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.208978:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209005:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.209009:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:2411:x1862023076054400:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 278us (521us total) trans 0 rc 0/0 00010000:00010000:3.0:1775764777.209022:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.209025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1374 00010000:00010000:3.0:1775764777.209037:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209092:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209100:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209108:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209114:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764777.209120:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209147:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209158:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:3.0:1775764777.209160:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764777.209164:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 2/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209169:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52309c lrc: 0/0,0 mode: --/CW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209179:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209185:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209190:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209196:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764777.209198:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209204:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209218:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x95597e60 (ffff96c1c2a03900) 00010000:00010000:3.0:1775764777.209221:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764777.209224:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 2/0,0 mode: --/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.209240:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230a3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x8:0x0].0x95597e60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1775764777.209243:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764777.209359:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:45648:x1862023076054272:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 7016us (7377us total) trans 0 rc -2/-2 00000100:00100000:3.0:1775764777.209368:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6368 00000100:00100000:2.0:1775764777.215420:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.215923:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076054528 00000100:00100000:3.0:1775764777.215937:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076054528 00000100:00100000:3.0:1775764777.215995:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6369 00000100:00100000:3.0:1775764777.216006:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+52:45648:x1862023076054528:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764777.216030:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764777.216053:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5230aa lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50e7 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.216092:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.217219:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.217235:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.217360:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5230aa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 54 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.217379:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 53 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.217401:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:3.0:1775764777.217404:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764777.217407:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9c00, rc 0) 00000100:00100000:3.0:1775764777.217485:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:45648:x1862023076054528:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1480us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.217493:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6369 00000100:00100000:2.0:1775764777.219825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.219893:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076054784 00000100:00100000:1.0:1775764777.219904:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076054784 00000100:00100000:1.0:1775764777.219972:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6370 00000100:00100000:1.0:1775764777.219983:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+53:45648:x1862023076054784:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1775764777.220062:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.220078:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.220090:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764777.220223:0:6523:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000669c65d2 reply state 00000000db841210 transno 4294970570 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.220262:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.220269:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:1.0:1775764777.220272:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1775764777.220277:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764777.220369:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:45648:x1862023076054784:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 388us (552us total) trans 4294970570 rc 0/0 00000100:00100000:1.0:1775764777.220376:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6370 00000100:00100000:0.0:1775764777.224248:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.224308:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076054912 00000100:00100000:3.0:1775764777.224319:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076054912 00000100:00100000:3.0:1775764777.224385:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6371 00000100:00100000:3.0:1775764777.224396:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:45648:x1862023076054912:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764777.224422:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764777.224441:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50ee expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.224510:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.224525:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.224535:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:3.0:1775764777.224538:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1775764777.224541:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764777.224602:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:45648:x1862023076054912:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 208us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.224619:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6371 00000100:00100000:2.0:1775764777.228715:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.228800:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076055040 00000100:00100000:3.0:1775764777.228812:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076055040 00000100:00100000:3.0:1775764777.228888:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1332 00000100:00100000:3.0:1775764777.228901:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+56:45648:x1862023076055040:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1775764777.229047:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+56:45648:x1862023076055040:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 Request processed in 149us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.229056:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1332 00000100:00100000:2.0:1775764777.230935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.231097:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076055296 00000100:00100000:0.0:1775764777.231107:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076055296 00000100:00100000:0.0:1775764777.231322:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1333 00000100:00100000:0.0:1775764777.231334:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+56:45648:x1862023076055296:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1775764777.231636:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:45648:x1862023076055296:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 304us (705us total) trans 4294970571 rc 0/0 00000100:00100000:0.0:1775764777.231644:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1333 00000100:00100000:0.0:1775764777.234229:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.236604:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076055552 00000100:00100000:3.0:1775764777.236618:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076055552 00000100:00100000:3.0:1775764777.236692:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6372 00000100:00100000:3.0:1775764777.236703:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+57:45648:x1862023076055552:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764777.236872:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+57:45648:x1862023076055552:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 171us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.236880:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6372 00000100:00100000:2.0:1775764777.240488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.240616:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076055808 00000100:00100000:3.0:1775764777.240625:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076055808 00000100:00100000:3.0:1775764777.240677:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6373 00000100:00100000:3.0:1775764777.240686:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+57:45648:x1862023076055808:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764777.240706:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764777.240724:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5230c6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50f5 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.240905:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.240938:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.240947:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.240994:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.241007:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 58 pid: 6521 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.241024:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099784704:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764777.241095:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2df6ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1775764777.245922:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099784704:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764777.245956:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764777.246910:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.247559:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076055936 00000100:00100000:0.0:1775764777.247568:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076055936 00010000:00010000:0.0:1775764777.247607:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 59 pid: 6521 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.247652:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1375 00000100:00100000:0.0:1775764777.247662:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+59:2411:x1862023076055936:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764777.247678:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764777.247686:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 59 pid: 6521 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.247698:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 59 pid: 6521 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.247720:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5230bf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50ee expref: 59 pid: 6521 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.247738:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:0.0:1775764777.247743:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.247845:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.247853:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.247886:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764777.247943:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+58:2411:x1862023076055936:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 282us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.247951:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1375 00010000:00010000:2.0:1775764777.249265:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249277:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764777.249296:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9a:0x0]: returning size 0 00000004:00080000:2.0:1775764777.249444:0:24980:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x53:0x0], index 1: 0 00010000:00010000:2.0:1775764777.249561:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249570:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249577:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249582:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764777.249586:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249607:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249620:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:2.0:1775764777.249623:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764777.249627:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.249633:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5230cd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.250089:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5230c6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50f5 expref: 58 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.250100:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:2.0:1775764777.250102:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764777.250106:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5230c6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50f5 expref: 58 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.250116:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9600, rc 0) 00000100:00100000:2.0:1775764777.250182:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+57:45648:x1862023076055808:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 9497us (9703us total) trans 4294970572 rc 301/301 00000100:00100000:2.0:1775764777.250190:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6373 00000100:00100000:2.0:1775764777.256225:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.256338:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076056192 00000100:00100000:3.0:1775764777.256349:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076056192 00000100:00100000:3.0:1775764777.256403:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1334 00000100:00100000:3.0:1775764777.256412:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dd67f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:45648:x1862023076056192:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764777.256766:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dd67f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+58:45648:x1862023076056192:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 343us (540us total) trans 4294970573 rc 0/0 00000100:00100000:3.0:1775764777.256802:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1334 00000100:00100000:2.0:1775764777.260695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.261310:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076056320 00000100:00100000:1.0:1775764777.261321:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076056320 00000100:00100000:1.0:1775764777.261418:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6374 00000100:00100000:1.0:1775764777.261428:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+58:45648:x1862023076056320:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764777.261453:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764777.261473:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5230db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd50fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.261542:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed5230e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.261566:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed5230e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.261579:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed5230e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764777.261624:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9a:0x0]: returning size 0 00000004:00200000:1.0:1775764777.261629:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764777.261664:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed5230e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.261692:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5230db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50fc expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.261709:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed5230e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50fc expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.261717:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:1.0:1775764777.261720:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1775764777.261724:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5800, rc 0) 00000100:00100000:1.0:1775764777.262268:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+59:45648:x1862023076056320:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 838us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.262277:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6374 00000100:00100000:0.0:1775764777.266694:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.266939:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076056448 00000100:00100000:3.0:1775764777.267069:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076056448 00000100:00100000:0.0:1775764777.267400:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1681 00000100:00100000:0.0:1775764777.267411:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076056448:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764777.267431:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764777.267452:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5103 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764777.267479:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1775764777.267501:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764777.267503:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764777.267523:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.267542:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.267731:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c000, rc 0) 00000100:00100000:0.0:1775764777.268108:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076056448:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 697us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.268116:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1681 00000100:00100000:3.0:1775764777.271737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00080000:2.0:1775764777.272945:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764777.273227:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076056704 00000100:00100000:0.0:1775764777.273239:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076056704 00000100:00100000:0.0:1775764777.273348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6375 00000100:00100000:0.0:1775764777.273358:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:45648:x1862023076056704:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764777.273481:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:45648:x1862023076056704:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 124us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.273489:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6375 00000100:00100000:3.0:1775764777.283851:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.284406:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076056832 00000100:00100000:1.0:1775764777.284419:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076056832 00000100:00100000:1.0:1775764777.284486:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1682 00000100:00100000:1.0:1775764777.284496:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:45648:x1862023076056832:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764777.284692:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764777.284715:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd510a expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.284750:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.284760:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764777.284763:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764777.284898:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.284936:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.284950:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 9 pid: 15167 timeout: 1385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764777.285072:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1862023099784832:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764777.285244:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1775764777.290479:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.290579:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076056960 00000100:00100000:0.0:1775764777.290588:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076056960 00010000:00010000:0.0:1775764777.290646:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 10 pid: 15167 timeout: 1385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.290699:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1376 00000100:00100000:0.0:1775764777.290709:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076056960:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764777.290728:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764777.291224:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 10 pid: 15167 timeout: 1385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.291240:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 10 pid: 15167 timeout: 1385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.291267:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764777.291269:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764777.291290:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.291299:0:24971:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.291335:0:24971:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.291349:0:24971:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3601c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:24971:1862023099784960:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764777.291416:0:24971:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2dfdc4180 going to sleep for 11 seconds 00010000:00010000:3.0:1775764777.293318:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fef181bf/0x6e98bd47ed5230e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5103 expref: 10 pid: 15167 timeout: 1385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.293340:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1862023099784832:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764777.293368:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.293383:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5200, rc 0) 00000100:00100000:3.0:1775764777.293451:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:45648:x1862023076056832:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 8956us (9622us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.293460:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1682 00000100:00100000:0.0:1775764777.314237:0:24971:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3601c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:24971:1862023099784960:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764777.314296:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764777.314473:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076056960:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 23763us (24001us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.314502:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1376 00000100:00100000:0.0:1775764777.339327:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764777.339722:0:8408:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076057088 00000100:00100000:2.0:1775764777.339734:0:8408:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076057088 00002000:00100000:2.0:1775764777.339877:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x53:0x0] (0->1048575) req@ffff96c1c3601c00 x1862023076057088/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:258/0 lens 488/0 e 0 to 0 dl 1775764788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764777.339889:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c3601c00 with x1862023076057088 ext(0->1048575) 00002000:00010000:2.0:1775764777.339895:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c3601c00 00000100:00100000:2.0:1775764777.339930:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 423 00000100:00100000:2.0:1775764777.339939:0:8408:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076057088:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1775764777.366418:0:8408:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076057088:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 Request processed in 26467us (27089us total) trans 4294967717 rc 0/0 00000100:00100000:0.0:1775764777.366432:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 423 00002000:00100000:0.0:1775764777.366447:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x53:0x0] (0->1048575) req@ffff96c1c3601c00 x1862023076057088/t4294967717(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:258/0 lens 488/448 e 0 to 0 dl 1775764788 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764777.366457:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c3601c00 with x1862023076057088 ext(0->1048575) 00002000:00010000:0.0:1775764777.366463:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c3601c00 00000001:00080000:1.0:1775764777.367268:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967717 is committed 00000001:00100000:1.0:1775764777.367283:0:9467:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000020:00000080:1.0:1775764777.367287:0:9467:0:(genops.c:904:class_export_put()) final put ffff96c1c4df4000/9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000020:00000080:3.0:1775764777.367362:0:22153:0:(genops.c:863:class_export_destroy()) destroying export ffff96c1c4df4000/9cbd2dce-6222-4b9d-952e-2776ae7cef01 for lustre-OST0001 00000020:00000080:3.0:1775764777.367426:0:22153:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff96c2c3eab800 for lustre-OST0001 00000100:00100000:3.0:1775764777.373526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.373610:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076057216 00000100:00100000:1.0:1775764777.373620:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076057216 00000100:00100000:1.0:1775764777.373686:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6376 00000100:00100000:1.0:1775764777.373696:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+59:45648:x1862023076057216:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1775764777.382826:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970573 is committed 00000001:00080000:1.0:1775764777.382859:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970567 is committed 00000004:00080000:1.0:1775764777.382865:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000020:00080000:1.0:1775764777.382887:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2d0af6000 refcount 2 committed 0 result 0 batchid 120 00000020:00080000:1.0:1775764777.382890:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2db5a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2c56553c0 00000020:00080000:1.0:1775764777.382892:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2db5c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2cbee00 00000100:00100000:1.0:1775764777.383084:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:45648:x1862023076057216:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 Request processed in 9384us (9572us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.383108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6376 00000020:00080000:0.0:1775764777.384688:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 120 committed batchid 119 00000020:00080000:0.0:1775764777.384845:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 119 00000100:00100000:1.0:1775764777.385765:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764777.385838:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099785088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1775764777.385911:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764777.386299:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099785088 00000100:00100000:3.0:1775764777.386307:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099785088 00000100:00100000:3.0:1775764777.386359:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:3.0:1775764777.386368:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1862023099785088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1775764777.386397:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:82 count 1 00002000:00010000:3.0:1775764777.386425:0:8402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x52:0x0] initial LVB size: 1048576, mtime: 0x69d80526, atime: 0x0, ctime: 0x69d80526, blocks: 0x800 00010000:00010000:3.0:1775764777.386433:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.386449:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764777.386461:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764777.386466:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.386482:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.386493:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.386500:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.386529:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1775764777.386757:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3663:x1862023099785088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 390us (846us total) trans 4294967717 rc 0/0 00000100:00100000:3.0:1775764777.386765:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00010000:00010000:3.0:1775764777.387431:0:6508:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764777.387439:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.387449:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764777.387454:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.387464:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.387499:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.387518:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7bf8be1/0x6e98bd47ed5230f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.387538:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764777.387540:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764777.387696:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1775764777.388439:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c2f98c4380/2, rc 0, transno 4294967717 00000100:00100000:3.0:1775764777.388450:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099785088:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1775764777.389237:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.389251:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.389259:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.389266:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764777.389271:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.389279:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.389295:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:2.0:1775764777.389298:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1775764777.389302:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.389308:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed5230b8 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.392515:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.392711:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076057344 00000100:00100000:1.0:1775764777.392721:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076057344 00000100:00100000:1.0:1775764777.392810:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1684 00000100:00100000:1.0:1775764777.392822:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076057344:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1775764777.392943:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076057344:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 Request processed in 124us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.392951:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1684 00000100:00100000:3.0:1775764777.397861:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764777.397950:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076057600 00000100:00100000:2.0:1775764777.397961:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076057600 00000100:00100000:2.0:1775764777.398061:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6377 00000100:00100000:2.0:1775764777.398071:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+48:45648:x1862023076057600:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1775764777.398126:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764777.398155:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed5230e2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50fc expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.398176:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:2.0:1775764777.398182:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764777.398215:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.398229:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.398239:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764777.398357:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000011314df9 reply state 000000002b1ba7c4 transno 4294970574 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.398368:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.398374:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:2.0:1775764777.398376:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764777.398379:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1775764777.398549:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+49:45648:x1862023076057600:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 479us (697us total) trans 4294970574 rc 0/0 00000100:00100000:2.0:1775764777.398573:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6377 00000100:00100000:3.0:1775764777.407725:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.407906:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076057728 00000100:00100000:1.0:1775764777.407921:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076057728 00000100:00100000:1.0:1775764777.407983:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6378 00000100:00100000:1.0:1775764777.407994:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:45648:x1862023076057728:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764777.408020:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764777.408040:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5111 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.408112:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.408127:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.408147:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:1.0:1775764777.408159:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1775764777.408163:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4600, rc 0) 00000100:00100000:1.0:1775764777.408220:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:45648:x1862023076057728:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 227us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.408227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6378 00000100:00100000:1.0:1775764777.417385:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.418055:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076057856 00000100:00100000:0.0:1775764777.418066:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076057856 00000100:00100000:0.0:1775764777.418128:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1685 00000100:00100000:0.0:1775764777.418139:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076057856:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1775764777.418294:0:24969:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1775764777.418298:0:24969:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb mtime from disk: 0 -> 1775764774 00002000:00010000:0.0:1775764777.418301:0:24969:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb atime from disk: 0 -> 1775764774 00002000:00010000:0.0:1775764777.418303:0:24969:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb ctime from disk: 0 -> 1775764774 00002000:00010000:0.0:1775764777.418305:0:24969:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x53:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1775764777.418379:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076057856:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 Request processed in 241us (1003us total) trans 4294967718 rc 0/0 00000100:00100000:0.0:1775764777.418388:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1685 00000100:00100000:2.0:1775764777.424426:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.424652:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076058112 00000100:00100000:0.0:1775764777.424664:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076058112 00000100:00100000:0.0:1775764777.424727:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6379 00000100:00100000:0.0:1775764777.424737:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:45648:x1862023076058112:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1775764777.424858:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.424877:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.424887:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.424922:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.424951:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 50 pid: 24980 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.424967:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3601180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099785216:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764777.425057:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2dfdc4180 going to sleep for 11 seconds 00000100:00100000:0.0:1775764777.427559:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3601180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099785216:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764777.427594:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764777.435917:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.436018:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076058240 00000100:00100000:1.0:1775764777.436029:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076058240 00010000:00010000:1.0:1775764777.436071:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 51 pid: 24980 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764777.436105:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1377 00000100:00100000:1.0:1775764777.436116:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+51:2409:x1862023076058240:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764777.436136:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764777.436143:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 51 pid: 24980 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.436157:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 51 pid: 24980 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.436179:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5230b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50e7 expref: 51 pid: 24980 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.436196:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:1.0:1775764777.436201:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.436211:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.436236:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.436274:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764777.436334:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:2409:x1862023076058240:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.436342:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1377 00010000:00010000:3.0:1775764777.436444:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436453:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436487:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436494:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436499:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436515:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6ca00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764777.436519:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436527:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436537:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:3.0:1775764777.436539:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1775764777.436543:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.436549:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed52310c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.436589:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+49:45648:x1862023076058112:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 Request processed in 11854us (12174us total) trans 0 rc -22/-22 00000100:00100000:3.0:1775764777.436597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6379 00000100:00100000:2.0:1775764777.439336:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.439468:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076058368 00000100:00100000:3.0:1775764777.439478:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076058368 00000100:00100000:3.0:1775764777.439535:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1686 00000100:00100000:3.0:1775764777.439554:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076058368:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764777.439604:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.439627:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.439657:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764777.439659:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764777.439662:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.439703:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.439719:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 9 pid: 8403 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.439735:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c49e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099785344:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764777.439979:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c3f22e40 going to sleep for 11 seconds 00000100:00100000:3.0:1775764777.446887:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c49e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099785344:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764777.446919:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764777.449825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.450226:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076058496 00000100:00100000:0.0:1775764777.450237:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076058496 00010000:00010000:0.0:1775764777.450278:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.450327:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1378 00000100:00100000:0.0:1775764777.450337:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076058496:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764777.450353:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764777.450373:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.450389:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.450413:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d82842a8/0x6e98bd47ed5230f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd510a expref: 10 pid: 8403 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.450452:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764777.450454:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764777.450460:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.450470:0:6506:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.450511:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764777.450582:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076058496:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 246us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.450591:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1378 00010000:00010000:3.0:1775764777.450661:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450671:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450692:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450708:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450717:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450724:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764777.450728:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450737:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450749:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.450757:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f09f6ae2/0x6e98bd47ed523113 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.450858:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076058368:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 11314us (11530us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.450866:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1686 00000100:00100000:2.0:1775764777.457964:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.458059:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076058752 00000100:00100000:1.0:1775764777.458069:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076058752 00000100:00100000:1.0:1775764777.458140:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6380 00000100:00100000:1.0:1775764777.458150:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:45648:x1862023076058752:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1775764777.458241:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458259:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458271:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458411:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458422:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458430:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458483:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.458507:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 50 pid: 6523 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764777.458522:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099785472:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764777.459084:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1775764777.465109:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764777.467139:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099785472:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764777.467180:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.467481:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076058880 00000100:00100000:3.0:1775764777.467490:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076058880 00010000:00010000:3.0:1775764777.467530:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 51 pid: 6523 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764777.467606:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1379 00000100:00100000:3.0:1775764777.467617:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076058880:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764777.467636:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764777.467643:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 51 pid: 6523 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.467655:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 51 pid: 6523 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.467678:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523105 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5111 expref: 51 pid: 6523 timeout: 1385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.467694:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:3.0:1775764777.467698:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.467707:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.467715:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.467744:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764777.467840:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:2411:x1862023076058880:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 215us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.467847:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1379 00010000:00010000:2.0:1775764777.467960:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.467969:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1775764777.468081:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970575 00000001:00080000:2.0:1775764777.468204:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970576 00000001:00080000:2.0:1775764777.468237:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970577 00000100:00100000:2.0:1775764777.468311:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff90e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1862023099785600:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1775764777.468366:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764777.468401:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8566600 going to sleep for 11 seconds 00000100:00100000:0.0:1775764777.468719:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099785600 00000100:00100000:0.0:1775764777.468725:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099785600 00000100:00100000:0.0:1775764777.468806:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1775764777.468815:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1862023099785600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1775764777.468902:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1862023099785600:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.468909:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1775764777.468943:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff90e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1862023099785600:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1775764777.469045:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970578 00000100:00100000:0.0:1775764777.469090:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3601180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1862023099785728:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1775764777.469118:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764777.469149:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c7e26780 going to sleep for 11 seconds 00000100:00100000:0.0:1775764777.469164:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099785728 00000100:00100000:0.0:1775764777.469179:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099785728 00000100:00100000:0.0:1775764777.469205:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1775764777.469212:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1862023099785728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1775764777.469301:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1862023099785728:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (182us total) trans 4294967719 rc 0/0 00000100:00100000:0.0:1775764777.469308:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1775764777.469337:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3601180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1862023099785728:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1775764777.469385:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970579 00010000:00010000:0.0:1775764777.469408:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469416:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469423:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469429:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764777.469433:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469441:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469454:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:0.0:1775764777.469457:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764777.469461:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469468:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523121 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469501:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469507:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469512:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469517:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764777.469519:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469525:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469533:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:0.0:1775764777.469535:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764777.469542:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469552:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469559:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.469584:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9400/0x6e98bd47ed523056 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd50d2 expref: 20 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.469607:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4aebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099785856:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764777.469667:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c7e26480 going to sleep for 11 seconds 00000100:00080000:2.0:1775764777.472103:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764777.473354:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.473457:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4aebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099785856:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764777.473485:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473495:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52304f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473525:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473538:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473561:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473572:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473578:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473584:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473590:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6ce00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764777.473594:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473617:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473630:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:0.0:1775764777.473632:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764777.473635:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473641:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523128 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473652:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473658:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473663:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473668:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764777.473670:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473675:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473682:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:0.0:1775764777.473684:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764777.473686:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764777.473702:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52311a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764777.473892:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:45648:x1862023076058752:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 15742us (15937us total) trans 4294970580 rc 0/0 00000100:00100000:0.0:1775764777.473904:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6380 00000020:00080000:0.0:1775764777.473910:0:6522:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1775764777.474073:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076059008 00000100:00100000:2.0:1775764777.474079:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076059008 00000100:00100000:2.0:1775764777.474128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1335 00000100:00100000:2.0:1775764777.474137:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:45645:x1862023076059008:12345-192.168.202.58@tcp:49:tar.0 00000100:00100000:2.0:1775764777.474230:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:45645:x1862023076059008:12345-192.168.202.58@tcp:49:tar.0 Request processed in 95us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764777.474242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1335 00000040:00080000:1.0:1775764777.474526:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764777.474531:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764777.475073:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1775764777.475081:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764777.479903:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764777.479976:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076059136 00000100:00100000:1.0:1775764777.479987:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076059136 00000100:00100000:1.0:1775764777.480057:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1687 00000100:00100000:1.0:1775764777.480066:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:45645:x1862023076059136:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:1.0:1775764777.480084:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764777.480102:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32e7275/0x6e98bd47ed52312f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5118 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764777.480135:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x53:0x0] initial LVB size: 1048576, mtime: 0x69d80526, atime: 0x69d80526, ctime: 0x69d80526, blocks: 0x800 00010000:00010000:1.0:1775764777.480157:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764777.480159:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764777.480167:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32e7275/0x6e98bd47ed52312f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5118 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.480229:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c32e7275/0x6e98bd47ed52312f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5118 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.480242:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4000, rc 0) 00000100:00100000:1.0:1775764777.480301:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:45645:x1862023076059136:12345-192.168.202.58@tcp:101:tar.0 Request processed in 235us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764777.480308:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1687 00000100:00100000:3.0:1775764777.481632:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00080000:2.0:1775764777.483025:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764777.483138:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076059392 00000100:00100000:1.0:1775764777.483149:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076059392 00000100:00100000:1.0:1775764777.483207:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1336 00000100:00100000:1.0:1775764777.483216:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c49e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+54:45648:x1862023076059392:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1775764777.483470:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000403:0x9a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1775764777.483507:0:6524:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970581 00010000:00010000:1.0:1775764777.483551:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.483566:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.483577:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.483585:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.483591:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.483647:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764777.483669:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1775764777.483749:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c49e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:45648:x1862023076059392:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 534us (2123us total) trans 4294970582 rc 0/0 00000100:00100000:1.0:1775764777.483757:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1336 00000020:00080000:1.0:1775764777.483761:0:6524:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1775764777.484635:0:9476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764777.484644:0:9476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.484653:0:9476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764777.484657:0:9476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.484666:0:9476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.484679:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:3.0:1775764777.484681:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1775764777.484686:0:9476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.484692:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523136 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.484704:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764777.484706:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764777.484708:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764777.488284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.488536:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076059520 00000100:00100000:0.0:1775764777.488557:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076059520 00002000:00100000:0.0:1775764777.488616:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x53:0x0] (0->12287) req@ffff96c1c49e5880 x1862023076059520/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:258/0 lens 488/0 e 0 to 0 dl 1775764788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764777.488627:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c49e5880 with x1862023076059520 ext(0->12287) 00002000:00010000:0.0:1775764777.488634:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c49e5880 00000100:00100000:0.0:1775764777.488672:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 424 00000100:00100000:0.0:1775764777.488682:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c49e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076059520:12345-192.168.202.58@tcp:3:tar.0 00000100:00100000:0.0:1775764777.488957:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c49e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076059520:12345-192.168.202.58@tcp:3:tar.0 Request processed in 275us (682us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1775764777.488965:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 424 00002000:00100000:0.0:1775764777.488972:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x53:0x0] (0->12287) req@ffff96c1c49e5880 x1862023076059520/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:258/0 lens 488/12728 e 0 to 0 dl 1775764788 ref 1 fl Complete:/600/0 rc 12288/12288 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764777.488980:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c49e5880 with x1862023076059520 ext(0->12287) 00002000:00010000:0.0:1775764777.488983:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c49e5880 00000100:00100000:0.0:1775764777.510632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764777.510746:0:8410:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076059648 00000100:00100000:2.0:1775764777.510758:0:8410:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076059648 00002000:00100000:2.0:1775764777.510874:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x53:0x0] (12288->1048575) req@ffff96c1c619ea00 x1862023076059648/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:258/0 lens 488/0 e 0 to 0 dl 1775764788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764777.510886:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c619ea00 with x1862023076059648 ext(12288->1048575) 00002000:00010000:2.0:1775764777.510893:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c619ea00 00000100:00100000:2.0:1775764777.510931:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 425 00000100:00100000:2.0:1775764777.510941:0:8410:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076059648:12345-192.168.202.58@tcp:3:tar.0 00000100:00100000:2.0:1775764777.549907:0:8410:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076059648:12345-192.168.202.58@tcp:3:tar.0 Request processed in 38773us (39092us total) trans 0 rc 1036288/1036288 00000100:00100000:2.0:1775764777.549921:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 425 00002000:00100000:2.0:1775764777.549935:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x53:0x0] (12288->1048575) req@ffff96c1c619ea00 x1862023076059648/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:258/0 lens 488/440 e 0 to 0 dl 1775764788 ref 1 fl Complete:/600/0 rc 1036288/1036288 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764777.549947:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c619ea00 with x1862023076059648 ext(12288->1048575) 00002000:00010000:2.0:1775764777.549954:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c619ea00 00000100:00100000:3.0:1775764777.561469:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764777.561873:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076059776 00000100:00100000:2.0:1775764777.561884:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076059776 00000100:00100000:2.0:1775764777.561950:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6381 00000100:00100000:2.0:1775764777.561959:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c49e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:45645:x1862023076059776:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:2.0:1775764777.561980:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764777.562000:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52313d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd511f expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.562262:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed523144 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x99:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.562278:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed523144 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.562290:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed523144 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764777.562320:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x99:0x0]: returning size 1048576 00000004:00200000:2.0:1775764777.562324:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764777.562344:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed523144 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.562369:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52313d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x99:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd511f expref: 23 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.562387:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0800/0x6e98bd47ed523144 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd511f expref: 22 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764777.562396:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x99:0x0].0x0 (ffff96c1c2a03800) 00010000:00010000:2.0:1775764777.562398:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764777.562402:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0800, rc 0) 00000100:00100000:2.0:1775764777.562468:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c49e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:45645:x1862023076059776:12345-192.168.202.58@tcp:101:tar.0 Request processed in 509us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764777.562476:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6381 00000100:00100000:3.0:1775764777.566836:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.566984:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060032 00000100:00100000:0.0:1775764777.567004:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060032 00000100:00100000:0.0:1775764777.567057:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1337 00000100:00100000:0.0:1775764777.567067:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c49e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:45645:x1862023076060032:12345-192.168.202.58@tcp:35:tar.0 00000100:00100000:0.0:1775764777.567325:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c49e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:45645:x1862023076060032:12345-192.168.202.58@tcp:35:tar.0 Request processed in 258us (555us total) trans 4294970583 rc 0/0 00000100:00100000:0.0:1775764777.567334:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1337 00000100:00100000:0.0:1775764777.570679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764777.570753:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060160 00000100:00100000:3.0:1775764777.570795:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060160 00000100:00100000:3.0:1775764777.570856:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6382 00000100:00100000:3.0:1775764777.570867:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c619f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:45645:x1862023076060160:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764777.570890:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764777.570912:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52314b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5126 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.571047:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed523152 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.571068:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed523152 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.571081:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed523152 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764777.571124:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1775764777.571128:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764777.571153:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed523152 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.571179:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52314b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5126 expref: 25 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.571198:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8200/0x6e98bd47ed523152 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5126 expref: 24 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764777.571207:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff96c1c4135100) 00010000:00010000:3.0:1775764777.571209:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764777.571214:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8200, rc 0) 00000100:00100000:3.0:1775764777.571265:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c619f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:45645:x1862023076060160:12345-192.168.202.58@tcp:101:tar.0 Request processed in 401us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764777.571271:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6382 00000100:00100000:2.0:1775764777.573527:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764777.573624:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060416 00000100:00100000:0.0:1775764777.573633:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060416 00000100:00100000:0.0:1775764777.573696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1338 00000100:00100000:0.0:1775764777.573703:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:45645:x1862023076060416:12345-192.168.202.58@tcp:35:tar.0 00000100:00100000:0.0:1775764777.574000:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:45645:x1862023076060416:12345-192.168.202.58@tcp:35:tar.0 Request processed in 297us (481us total) trans 4294970584 rc 0/0 00000100:00100000:0.0:1775764777.574006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1338 00000100:00100000:2.0:1775764777.779077:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764777.779119:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099785984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1775764777.779199:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764777.779321:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099785984 00000100:00100000:0.0:1775764777.779331:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099785984 00000100:00100000:0.0:1775764777.779389:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1775764777.779398:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099785984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1775764777.779434:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:0.0:1775764777.779490:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099785984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764777.779497:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1775764777.779953:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099785984:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1775764777.843459:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764777.843469:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764777.844075:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764777.844087:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1775764777.844372:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764778.121732:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764778.121815:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764778.121856:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764778.121914:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060928 00000100:00100000:2.0:1775764778.121925:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060928 00000100:00100000:2.0:1775764778.121978:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1331 00000100:00100000:2.0:1775764778.121985:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076060928:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764778.122045:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076060928:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.122053:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1331 00000100:00100000:3.0:1775764778.122089:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060672 00000100:00100000:3.0:1775764778.122095:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060672 00000100:00100000:3.0:1775764778.122144:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061184 00000100:00100000:3.0:1775764778.122147:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061184 00000100:00100000:3.0:1775764778.122175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1840 00000100:00100000:3.0:1775764778.122185:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076060672:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764778.122186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764778.122208:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764778.122238:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076060672:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 55us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.122245:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1840 00000100:00100000:3.0:1775764778.122260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1841 00000100:00100000:3.0:1775764778.122266:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076061184:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764778.122344:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061440 00000100:00100000:2.0:1775764778.122349:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061440 00000100:00100000:2.0:1775764778.122373:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1332 00000100:00100000:2.0:1775764778.122377:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076061440:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764778.129643:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764778.129740:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060800 00000100:00100000:3.0:1775764778.129750:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060800 00000100:00100000:1.0:1775764778.130976:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764778.131052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1842 00000100:00100000:3.0:1775764778.131065:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076060800:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764778.131133:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076060800:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 71us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.131141:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1842 00000100:00100000:3.0:1775764778.131226:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061056 00000100:00100000:3.0:1775764778.131233:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061056 00000100:00100000:1.0:1775764778.131245:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764778.131270:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061312 00000100:00100000:1.0:1775764778.131274:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061312 00000100:00100000:3.0:1775764778.131275:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1333 00000100:00100000:3.0:1775764778.131286:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076061056:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764778.131299:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1334 00000100:00100000:1.0:1775764778.131304:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076061312:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764778.131326:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076061312:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764778.131330:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1334 00000100:00100000:1.0:1775764778.131344:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076060544 00000100:00100000:1.0:1775764778.131347:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076060544 00000100:00100000:1.0:1775764778.131363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 951 00000100:00100000:1.0:1775764778.131367:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c85f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076060544:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764778.131412:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076061056:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 127us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.131419:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1333 00000100:00100000:3.0:1775764778.131450:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076061184:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 9184us (9594us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.131463:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1841 00000100:00100000:1.0:1775764778.131649:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c85f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076060544:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 280us (9439us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764778.131654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 951 00000100:00100000:0.0:1775764778.136134:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076061440:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 13737us (13930us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764778.136147:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1332 00000100:00080000:2.0:1775764778.143901:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1775764778.143913:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764778.291425:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099786368:0@lo:400:kworker.0 00000100:00100000:1.0:1775764778.291595:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.291649:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099786880:0@lo:400:kworker.0 00000100:00100000:1.0:1775764778.291670:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.291685:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099787392:0@lo:400:kworker.0 00000100:00100000:1.0:1775764778.291696:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.291712:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1775764778.291715:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099786240:0@lo:400:kworker.0 00000100:00100000:1.0:1775764778.291727:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.291735:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099786752:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292070:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099786496:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292094:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292113:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099787008:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292131:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292141:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099787520:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292152:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292162:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1775764778.292178:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099786112:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292197:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292210:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099786624:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292222:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292232:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099787136:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292244:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292252:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099787648:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292262:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764778.292284:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786880 00000100:00100000:2.0:1775764778.292290:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786880 00000100:00100000:2.0:1775764778.292328:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787392 00000100:00100000:2.0:1775764778.292329:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787392 00000100:00100000:2.0:1775764778.292339:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786240 00000100:00100000:2.0:1775764778.292340:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786240 00000100:00100000:2.0:1775764778.292349:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786496 00000100:00100000:2.0:1775764778.292351:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786496 00000100:00100000:2.0:1775764778.292360:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1775764778.292365:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f99a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099786880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292413:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f99a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099786880:12345-0@lo:400:kworker.0 Request processed in 48us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.292419:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1775764778.292431:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:2.0:1775764778.292434:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099787392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292448:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099787392:12345-0@lo:400:kworker.0 Request processed in 15us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.292452:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:2.0:1775764778.292457:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:1.0:1775764778.292647:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.292657:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099787264:0@lo:400:kworker.0 00000100:00100000:1.0:1775764778.292668:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.292687:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099786880:0@lo:400:kworker.0 00000100:00100000:1.0:1775764778.292693:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099787392:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292929:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099786240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.292969:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099786240:12345-0@lo:400:kworker.0 Request processed in 43us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.292975:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:2.0:1775764778.292989:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786752 00000100:00100000:2.0:1775764778.292992:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786752 00000100:00100000:2.0:1775764778.293004:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787264 00000100:00100000:2.0:1775764778.293005:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787264 00000100:00100000:2.0:1775764778.293013:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:2.0:1775764778.293016:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099786496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.293040:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099786496:12345-0@lo:400:kworker.0 Request processed in 24us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.293054:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:2.0:1775764778.293062:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:2.0:1775764778.293066:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099786752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.293081:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099786752:12345-0@lo:400:kworker.0 Request processed in 16us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.293084:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:2.0:1775764778.293090:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1775764778.293093:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099787264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.293105:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099787264:12345-0@lo:400:kworker.0 Request processed in 12us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.293108:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1775764778.293121:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786112 00000100:00100000:2.0:1775764778.293122:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786112 00000100:00100000:3.0:1775764778.293180:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786368 00000100:00100000:3.0:1775764778.293183:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786368 00000100:00100000:3.0:1775764778.293203:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099786624 00000100:00100000:3.0:1775764778.293204:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099786624 00000100:00100000:3.0:1775764778.293211:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1775764778.293215:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f99a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099786368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.293242:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f99a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099786368:12345-0@lo:400:kworker.0 Request processed in 27us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.293246:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1775764778.293254:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1775764778.293257:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099786624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.293270:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099786624:12345-0@lo:400:kworker.0 Request processed in 14us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.293274:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1775764778.293289:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787008 00000100:00100000:3.0:1775764778.293291:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787008 00000100:00100000:3.0:1775764778.293306:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787520 00000100:00100000:3.0:1775764778.293307:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787520 00000100:00100000:3.0:1775764778.293317:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787136 00000100:00100000:3.0:1775764778.293318:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787136 00000100:00100000:3.0:1775764778.293324:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787648 00000100:00100000:3.0:1775764778.293326:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787648 00000100:00100000:3.0:1775764778.293333:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1775764778.293336:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f6792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099787008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.293353:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f6792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099787008:12345-0@lo:400:kworker.0 Request processed in 17us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.293365:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1775764778.293499:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1775764778.293503:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099787520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.293522:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099787520:12345-0@lo:400:kworker.0 Request processed in 19us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.293525:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1775764778.293531:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1775764778.293534:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3661:x1862023099787136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.293546:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3661:x1862023099787136:12345-0@lo:400:kworker.0 Request processed in 12us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.293549:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1775764778.293554:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1775764778.293557:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.293569:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099787648:12345-0@lo:400:kworker.0 Request processed in 11us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764778.293572:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00080000:3.0:1775764778.293608:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764778.293611:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764778.293613:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764778.293614:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764778.293931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1775764778.293937:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099786112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.293967:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099786112:12345-0@lo:400:kworker.0 Request processed in 31us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764778.293971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1775764778.294003:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099786112:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.294010:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099786624:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.294017:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099787136:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.294023:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099787648:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.294028:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099786496:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.294033:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099787008:0@lo:400:kworker.0 00000100:00100000:2.0:1775764778.294038:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099787520:0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.294631:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099786240:0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.294639:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099786752:0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.294646:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099787264:0@lo:400:kworker.0 00000100:00100000:3.0:1775764778.294653:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099786368:0@lo:400:kworker.0 00000001:00100000:0.0:1775764778.297313:0:7436:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000001:00080000:0.0:1775764778.297336:0:7436:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968424 is committed 00000020:00000080:0.0:1775764778.297342:0:7436:0:(genops.c:904:class_export_put()) final put ffff96c1c4889000/9cbd2dce-6222-4b9d-952e-2776ae7cef01 00000020:00000080:3.0:1775764778.297619:0:22153:0:(genops.c:863:class_export_destroy()) destroying export ffff96c1c4889000/9cbd2dce-6222-4b9d-952e-2776ae7cef01 for lustre-MDT0001 00000020:00000080:3.0:1775764778.297687:0:22153:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff96c1c488f800 for lustre-MDT0001 00000100:00100000:2.0:1775764778.802022:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c66a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099787776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764778.802084:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.802196:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787776 00000100:00100000:1.0:1775764778.802203:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787776 00000100:00100000:1.0:1775764778.802243:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1775764778.802249:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099787776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764778.802273:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 493351104 pending 0 free 3887603712 avail 3655008256 00000100:00100000:1.0:1775764778.802324:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099787776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764778.802329:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1775764778.802385:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c66a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099787776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764778.807185:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099787904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764778.807254:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764778.807447:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099787904 00000100:00100000:1.0:1775764778.807455:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099787904 00000100:00100000:1.0:1775764778.807538:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1775764778.807548:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099787904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764778.807573:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 493351104 pending 0 free 3887603712 avail 3655008256 00000100:00100000:1.0:1775764778.807627:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099787904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764778.807634:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:0.0:1775764778.807738:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099787904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1775764778.867047:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764779.893277:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764780.850546:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099788032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764780.850615:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764780.850794:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788032 00000100:00100000:3.0:1775764780.850812:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788032 00000100:00100000:3.0:1775764780.850865:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1775764780.850874:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099788032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764780.850909:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444245504 avail 1298006016 00000100:00100000:3.0:1775764780.850971:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099788032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764780.850979:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:1.0:1775764780.851067:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099788032:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764780.914283:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764781.875763:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1775764781.875819:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099788288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764781.875888:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764781.875954:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788288 00000100:00100000:2.0:1775764781.875961:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788288 00000100:00100000:2.0:1775764781.876016:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1775764781.876028:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3664:x1862023099788288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1775764781.876070:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 24514752 pending 0 free 3916959744 avail 3685437440 00000100:00100000:2.0:1775764781.876115:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3664:x1862023099788288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764781.876123:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:2.0:1775764781.876274:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764781.876311:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099788288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764781.876389:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099788160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764781.876429:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764781.876500:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788160 00000100:00100000:0.0:1775764781.876505:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788160 00000100:00100000:0.0:1775764781.876548:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1775764781.876554:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099788160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1775764781.876565:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 24514752 pending 0 free 3916959744 avail 3685437440 00000100:00100000:0.0:1775764781.876605:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099788160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764781.876612:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1775764781.876891:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099788160:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1775764781.877161:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1775764781.938202:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1775764782.400899:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967717 is committed 00000100:00100000:1.0:1775764782.908306:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764782.908546:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061568 00000100:00100000:3.0:1775764782.908554:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061568 00000100:00100000:3.0:1775764782.908620:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6383 00000100:00100000:3.0:1775764782.908631:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:45621:x1862023076061568:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1775764782.908737:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:45621:x1862023076061568:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 108us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764782.908745:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6383 00000100:00080000:3.0:1775764782.908995:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764782.911426:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764782.911455:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c66aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099788416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764782.911533:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764782.911616:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788416 00000100:00100000:0.0:1775764782.911625:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788416 00000100:00100000:0.0:1775764782.911674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1775764782.911683:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099788416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1775764782.911725:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:0.0:1775764782.911811:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099788416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764782.911820:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1775764782.911870:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c66aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099788416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764782.919886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764782.921608:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061696 00000100:00100000:0.0:1775764782.921622:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061696 00000100:00100000:0.0:1775764782.921720:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6384 00000100:00100000:0.0:1775764782.921730:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:45621:x1862023076061696:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764782.921866:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:45621:x1862023076061696:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 137us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764782.921874:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6384 00000100:00080000:2.0:1775764782.922517:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1775764782.923344:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967719 is committed 00000001:00080000:0.0:1775764782.923353:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967718 is committed 00000001:00080000:0.0:1775764782.924042:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970584 is committed 00000001:00080000:0.0:1775764782.924070:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970582 is committed 00000020:00080000:0.0:1775764782.924082:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2d1b7d600 refcount 2 committed 0 result 0 batchid 121 00000020:00080000:0.0:1775764782.924087:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2db5e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2dfdc4180 00000020:00080000:0.0:1775764782.924090:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2db5700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2c8ac00 00000020:00080000:0.0:1775764782.924116:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 120 batchid updated 00000020:00080000:2.0:1775764782.924178:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 121 committed batchid 120 00000020:00080000:2.0:1775764782.924243:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 120 00010000:00010000:1.0:1775764782.924295:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764782.924307:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764782.924315:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764782.924333:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764782.924337:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764782.924345:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764782.924361:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff96c1c2a03a00) 00010000:00010000:1.0:1775764782.924365:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764782.924370:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764782.924376:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5230fe lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x9a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764782.966011:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764783.239046:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764783.239096:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764783.239127:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061824 00000100:00100000:3.0:1775764783.239133:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764783.239138:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061824 00000100:00100000:3.0:1775764783.239161:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764783.239182:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764783.239187:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 953 00000100:00100000:3.0:1775764783.239198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764783.239199:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076061824:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764783.239272:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076061824:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764783.239280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 953 00000100:00100000:0.0:1775764783.239294:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076062080 00000100:00100000:0.0:1775764783.239298:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076062080 00000100:00100000:0.0:1775764783.239337:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076062592 00000100:00100000:0.0:1775764783.239339:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076062592 00000100:00100000:0.0:1775764783.239355:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076061952 00000100:00100000:0.0:1775764783.239357:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076061952 00000100:00100000:0.0:1775764783.239376:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1339 00000100:00100000:0.0:1775764783.239383:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076062080:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764783.239610:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076062336 00000100:00100000:2.0:1775764783.239615:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076062336 00000100:00100000:2.0:1775764783.239647:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076062208 00000100:00100000:2.0:1775764783.239650:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076062208 00000100:00100000:2.0:1775764783.239683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1849 00000100:00100000:2.0:1775764783.239690:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076062336:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764783.243582:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764783.245605:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076062464 00000100:00100000:3.0:1775764783.245621:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076062464 00000100:00100000:3.0:1775764783.245684:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1340 00000100:00100000:3.0:1775764783.245694:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076062592:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764783.245766:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076062592:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 74us (6604us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.245799:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1340 00000100:00100000:3.0:1775764783.245816:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1341 00000100:00100000:3.0:1775764783.245823:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076061952:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764783.249701:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076061952:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 3864us (10503us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.249718:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1341 00000100:00100000:3.0:1775764783.249760:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1342 00000100:00100000:3.0:1775764783.249798:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076062464:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764783.249866:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076062464:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 99us (6298us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.249873:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1342 00000100:00100000:3.0:1775764783.250044:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1850 00000100:00100000:3.0:1775764783.250055:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:2408:x1862023076062208:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764783.250095:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:2408:x1862023076062208:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 43us (10895us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.250103:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1850 00000100:00080000:3.0:1775764783.250578:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764783.250607:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764783.250611:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764783.250614:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764783.253892:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076062080:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 14494us (14780us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764783.253909:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1339 00000100:00100000:2.0:1775764783.261243:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076062336:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21537us (22092us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764783.261259:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1849 00000100:00100000:1.0:1775764783.411039:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099788544:0@lo:400:kworker.0 00000100:00100000:1.0:1775764783.411125:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764783.411329:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788544 00000100:00100000:0.0:1775764783.411338:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788544 00000100:00100000:0.0:1775764783.411421:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1775764783.411430:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099788544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.414225:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099788672:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.414299:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.414363:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788672 00000100:00100000:3.0:1775764783.414370:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788672 00000100:00100000:3.0:1775764783.414422:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:3.0:1775764783.414431:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099788672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.414479:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099788672:12345-0@lo:400:kworker.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.414486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:3.0:1775764783.414527:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099788672:0@lo:400:kworker.0 00000100:00100000:0.0:1775764783.415404:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099788544:12345-0@lo:400:kworker.0 Request processed in 3972us (4275us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764783.415415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1775764783.415765:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764783.415799:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099789056:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.415839:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764783.415874:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789056 00000100:00100000:2.0:1775764783.415879:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789056 00000100:00100000:2.0:1775764783.415916:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1775764783.415924:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099789056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.415981:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099789056:12345-0@lo:400:kworker.0 Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764783.415987:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1775764783.416021:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099789056:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416064:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099789184:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416214:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764783.416244:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789184 00000100:00100000:2.0:1775764783.416247:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789184 00000100:00100000:2.0:1775764783.416280:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:2.0:1775764783.416286:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416317:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099789184:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764783.416322:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00080000:2.0:1775764783.416336:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764783.416353:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099789184:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416400:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764783.416407:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099789568:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416428:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764783.416453:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789568 00000100:00100000:2.0:1775764783.416457:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789568 00000100:00100000:2.0:1775764783.416484:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1775764783.416705:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099789568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416741:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099789568:12345-0@lo:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764783.416747:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00080000:2.0:1775764783.416804:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764783.416821:0:3662:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967717 gen 2 00000004:00080000:2.0:1775764783.416827:0:3662:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967716 committed transno 4294967717 00000004:00080000:2.0:1775764783.416844:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c2f98c4380, transno 4294967717 00000100:00100000:2.0:1775764783.416857:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099789568:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.416993:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099789696:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.417017:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764783.418398:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764783.418409:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099790080:0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.418454:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.419646:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099788928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.419709:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.419742:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099789440:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.419766:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.419839:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099789952:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.419861:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.419885:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1775764783.419892:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099788800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.419917:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.419939:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099789312:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.419958:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.419977:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099789824:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.420016:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.420063:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788800 00000100:00100000:2.0:1775764783.420716:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789696 00000100:00100000:2.0:1775764783.420721:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789696 00000100:00100000:2.0:1775764783.420804:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099788928 00000100:00100000:2.0:1775764783.420808:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788928 00000100:00100000:2.0:1775764783.420824:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789312 00000100:00100000:2.0:1775764783.420827:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789312 00000100:00100000:2.0:1775764783.420842:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789824 00000100:00100000:2.0:1775764783.420844:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789824 00000100:00100000:2.0:1775764783.420863:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1775764783.420871:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099789696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.420940:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099789696:12345-0@lo:400:kworker.0 Request processed in 70us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764783.420947:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1775764783.420981:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:2.0:1775764783.420988:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764783.421022:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099788928:12345-0@lo:400:kworker.0 Request processed in 35us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.421584:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099788800 00000100:00100000:3.0:1775764783.421641:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:3.0:1775764783.421648:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099788800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.421704:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099788800:12345-0@lo:400:kworker.0 Request processed in 57us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.421711:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:3.0:1775764783.421735:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099790080 00000100:00100000:3.0:1775764783.421740:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099790080 00000100:00100000:3.0:1775764783.421795:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789440 00000100:00100000:3.0:1775764783.421799:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789440 00000100:00100000:3.0:1775764783.421824:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099789952 00000100:00100000:3.0:1775764783.421827:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099789952 00000100:00100000:3.0:1775764783.421841:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1775764783.421847:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099790080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.421906:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099790080:12345-0@lo:400:kworker.0 Request processed in 59us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.421912:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1775764783.421923:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1775764783.421928:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099789440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.421954:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099789440:12345-0@lo:400:kworker.0 Request processed in 27us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.421959:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1775764783.421968:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:3.0:1775764783.421974:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099789952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.421998:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099789952:12345-0@lo:400:kworker.0 Request processed in 24us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.422018:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1775764783.422654:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:1.0:1775764783.426611:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099788544:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427051:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1775764783.427085:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099789312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427189:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099789312:12345-0@lo:400:kworker.0 Request processed in 128us (7230us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.427197:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1775764783.427225:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1775764783.427233:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099789824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427261:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099789824:12345-0@lo:400:kworker.0 Request processed in 29us (7245us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.427267:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1775764783.427338:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099788800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427349:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099789312:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427359:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099789824:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427369:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099788928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427379:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099789440:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427401:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099789952:0@lo:400:kworker.0 00000100:00080000:3.0:1775764783.427450:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764783.427456:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764783.427459:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764783.427462:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764783.427501:0:3662:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967719 gen 2 00000004:00080000:3.0:1775764783.427507:0:3662:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967719 committed transno 4294967719 00000100:00100000:3.0:1775764783.427540:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099790080:0@lo:400:kworker.0 00000100:00100000:3.0:1775764783.427556:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099789696:0@lo:400:kworker.0 00000100:00100000:0.0:1775764783.923170:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775764783.923194:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c66ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099790208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764783.923260:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764783.927659:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099790208 00000100:00100000:1.0:1775764783.927676:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099790208 00000100:00100000:1.0:1775764783.927745:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1775764783.927755:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099790208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764783.927815:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 493351104 pending 0 free 3886555136 avail 3655032832 00000100:00100000:1.0:1775764783.927896:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099790208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764783.927903:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1775764783.928000:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c66ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099790208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764783.929369:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1775764783.929388:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099790336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764783.929442:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764783.929532:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099790336 00000100:00100000:3.0:1775764783.929538:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099790336 00000100:00100000:3.0:1775764783.929591:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1775764783.929602:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099790336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1775764783.929619:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 493351104 pending 0 free 3886555136 avail 3655032832 00000100:00100000:3.0:1775764783.929663:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099790336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764783.929669:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1775764783.929712:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099790336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1775764783.986354:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1775764784.795607:0:29873:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 15:59:42 (1775764782) 00010000:00010000:2.0:1775764785.020737:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764785.099585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.099803:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076062848 00000100:00100000:3.0:1775764785.099814:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076062848 00000100:00100000:3.0:1775764785.099895:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6385 00000100:00100000:3.0:1775764785.099905:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+46:46259:x1862023076062848:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764785.099929:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764785.099952:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523159 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd512d expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100034:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100051:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100075:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100099:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100107:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100115:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100224:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52316e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100234:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52316e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100242:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52316e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764785.100252:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1775764785.100343:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100351:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100358:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100364:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764785.100369:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100385:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100398:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:3.0:1775764785.100401:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764785.100407:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100414:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523160 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100426:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100432:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100438:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100443:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764785.100445:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100451:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100458:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c1c2b83000) 00010000:00010000:3.0:1775764785.100461:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764785.100463:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100477:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523167 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100740:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523159 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd512d expref: 49 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100754:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52316e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd512d expref: 48 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.100812:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764785.100814:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764785.100817:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764785.100887:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+48:46259:x1862023076062848:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 983us (1323us total) trans 4294970585 rc 0/0 00000100:00100000:3.0:1775764785.100895:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6385 00000100:00080000:0.0:1775764785.101138:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764785.122494:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.122611:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.122810:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076063232 00000100:00100000:3.0:1775764785.122820:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076063232 00000100:00100000:3.0:1775764785.122878:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1339 00000100:00100000:3.0:1775764785.122888:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:46259:x1862023076063232:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764785.123151:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:46259:x1862023076063232:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 263us (668us total) trans 4294970586 rc 0/0 00000100:00100000:3.0:1775764785.123159:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1339 00000100:00100000:2.0:1775764785.126336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.127875:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076063104 00000100:00100000:1.0:1775764785.127889:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076063104 00000100:00100000:3.0:1775764785.128106:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076063360 00000100:00100000:3.0:1775764785.128111:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076063360 00000100:00100000:3.0:1775764785.128169:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6386 00000100:00100000:3.0:1775764785.128178:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:46259:x1862023076063360:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1775764785.128339:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:46259:x1862023076063360:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 161us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.128348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6386 00000100:00100000:0.0:1775764785.128554:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 740 00000100:00100000:0.0:1775764785.128563:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+49:2411:x1862023076063104:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764785.128574:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764785.128599:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52316e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd512d expref: 49 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.128617:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764785.128621:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764785.129158:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+48:2411:x1862023076063104:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 594us (6544us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.129166:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 740 00000100:00100000:2.0:1775764785.131961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.132159:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076063488 00000100:00100000:0.0:1775764785.132172:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076063488 00000100:00100000:0.0:1775764785.132280:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6387 00000100:00100000:0.0:1775764785.132290:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:46259:x1862023076063488:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1775764785.132470:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764785.132727:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:46259:x1862023076063488:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 437us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.132736:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6387 00000100:00100000:2.0:1775764785.145225:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.145388:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076063616 00000100:00100000:3.0:1775764785.145399:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076063616 00000100:00100000:3.0:1775764785.145532:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6388 00000100:00100000:3.0:1775764785.145543:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:46260:x1862023076063616:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764785.145565:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764785.145600:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52317c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5134 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145678:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145693:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145704:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145719:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145726:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145733:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145967:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145976:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145982:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145988:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.145994:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764785.145999:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146006:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146018:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764785.146021:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764785.146025:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146032:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146047:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146169:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146181:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146186:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764785.146188:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146194:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146201:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x342303f9 (ffff96c1c2b83000) 00010000:00010000:3.0:1775764785.146204:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764785.146206:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146211:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52318a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146242:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52317c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5134 expref: 24 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146252:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764785.146254:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764785.146257:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52317c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5134 expref: 24 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.146265:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764785.146371:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:46260:x1862023076063616:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 830us (1155us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764785.146390:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6388 00000100:00080000:0.0:1775764785.146739:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764785.155383:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.156835:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076063872 00000100:00100000:3.0:1775764785.156855:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076063872 00000100:00100000:3.0:1775764785.157010:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6389 00000100:00100000:3.0:1775764785.157022:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:46260:x1862023076063872:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:3.0:1775764785.157110:0:10088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764785.157146:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed522f3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5070 expref: 23 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.157180:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764785.157186:0:10088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764785.157254:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.157270:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 47 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.157279:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.157318:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 47 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.157332:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 47 pid: 10088 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.157348:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4baa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099790464:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764785.158406:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764785.164298:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.164525:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076064000 00000100:00100000:0.0:1775764785.164537:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076064000 00010000:00010000:0.0:1775764785.164587:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 48 pid: 10088 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764785.164629:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1380 00000100:00100000:0.0:1775764785.164824:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+48:2410:x1862023076064000:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764785.164841:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764785.164849:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 48 pid: 10088 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.164863:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 48 pid: 10088 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.164888:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764785.164893:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.164902:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.164909:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.164950:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764785.165021:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+48:2410:x1862023076064000:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 209us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.165030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1380 00010000:00010000:3.0:1775764785.165416:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed522eb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5046 expref: 47 pid: 10088 timeout: 1392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.165434:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4baa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099790464:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764785.165467:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.165876:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.165886:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.165919:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x342303f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.165929:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.165938:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166514:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166525:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166542:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764785.166559:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aa0bfdf4 reply state 000000000364e731 transno 4294970587 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166570:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166577:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.166580:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764785.166583:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1775764785.166589:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1775764785.166597:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166603:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166610:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166616:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.166620:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166627:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166637:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764785.166639:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.166649:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166655:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523191 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764785.166667:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aa0bfdf4 reply state 000000000364e731 transno 4294970587 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166675:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.166681:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x342303f9 (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764785.166683:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764785.166685:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1775764785.166842:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:46260:x1862023076063872:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 9820us (11467us total) trans 4294970587 rc 0/0 00000100:00100000:1.0:1775764785.166850:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6389 00000100:00100000:2.0:1775764785.195624:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.195832:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076064128 00000100:00100000:1.0:1775764785.195844:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076064128 00000100:00100000:1.0:1775764785.195918:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6390 00000100:00100000:1.0:1775764785.195929:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:46261:x1862023076064128:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:1.0:1775764785.195957:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.195993:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd513b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.196087:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5231ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.196106:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5231ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.196141:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5231ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764785.196201:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764785.196205:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764785.196226:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5231ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.196250:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd513b expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.196269:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5231ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd513b expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.196279:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764785.196282:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764785.196285:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5200, rc 0) 00000100:00100000:1.0:1775764785.196347:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:46261:x1862023076064128:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 421us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.196355:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6390 00000100:00100000:0.0:1775764785.200199:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.200253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.200396:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076064256 00000100:00100000:3.0:1775764785.200407:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076064256 00000100:00100000:3.0:1775764785.200464:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076064512 00000100:00100000:3.0:1775764785.200467:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076064512 00000100:00100000:3.0:1775764785.200497:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6391 00000100:00100000:1.0:1775764785.200507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6392 00000100:00100000:3.0:1775764785.200507:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:2408:x1862023076064256:12345-192.168.202.58@tcp:41:mkdir.0 00000100:00100000:1.0:1775764785.200515:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:46261:x1862023076064512:12345-192.168.202.58@tcp:36:mkdir.0 00000004:00000024:3.0:1775764785.200547:0:14288:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444241408 avail 1298001920 00010000:00010000:1.0:1775764785.200567:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764785.200599:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed5231ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd513b expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.200621:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764785.200645:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764785.200646:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:2408:x1862023076064256:12345-192.168.202.58@tcp:41:mkdir.0 Request processed in 141us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.200654:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6391 00000100:00100000:1.0:1775764785.200745:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:46261:x1862023076064512:12345-192.168.202.58@tcp:36:mkdir.0 Request processed in 230us (491us total) trans 0 rc -17/-17 00000100:00100000:1.0:1775764785.200752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6392 00000100:00100000:2.0:1775764785.204351:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.204436:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076064640 00000100:00100000:1.0:1775764785.204446:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076064640 00000100:00100000:1.0:1775764785.204508:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6393 00000100:00100000:1.0:1775764785.204517:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+24:46261:x1862023076064640:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:1.0:1775764785.204538:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.204560:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5231b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5142 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.204725:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5231bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.204738:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5231bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.204749:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5231bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764785.204844:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764785.204848:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764785.204868:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5231bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.204892:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5231b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5142 expref: 26 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.204911:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5231bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5142 expref: 25 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.204937:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764785.204940:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764785.204944:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4600, rc 0) 00000100:00100000:1.0:1775764785.204999:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:46261:x1862023076064640:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 483us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.205006:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6393 00000100:00100000:3.0:1775764785.210440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.210518:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076064768 00000100:00100000:1.0:1775764785.210529:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076064768 00000100:00100000:1.0:1775764785.210586:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6394 00000100:00100000:1.0:1775764785.210594:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+25:46261:x1862023076064768:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:1.0:1775764785.210614:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.210641:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5149 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210698:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210709:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210717:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210723:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210727:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210743:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210859:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5231d7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210867:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5231d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210874:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5231d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764785.210912:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1775764785.210917:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764785.210937:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5231d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210947:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210952:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210956:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210960:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210963:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.210966:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210978:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.210989:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764785.210992:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.210996:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211002:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211015:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211021:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211027:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211032:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.211035:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211040:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211047:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x342303f9 (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764785.211049:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.211051:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211064:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211089:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5149 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211101:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5231d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5149 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.211108:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.211111:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764785.211113:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5600, rc 0) 00000100:00100000:1.0:1775764785.211168:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:46261:x1862023076064768:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 574us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.211175:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6394 00000100:00100000:0.0:1775764785.218973:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.219111:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065024 00000100:00100000:1.0:1775764785.219122:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065024 00000100:00100000:1.0:1775764785.219187:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6395 00000100:00100000:1.0:1775764785.219207:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:46261:x1862023076065024:12345-192.168.202.58@tcp:36:mkdir.0 00010000:00010000:1.0:1775764785.219503:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764785.219535:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5231d7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5149 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.219555:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.219560:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764785.219619:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.219661:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.219670:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.219724:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0x43454b14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.219732:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.219738:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220510:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,1 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220522:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220531:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764785.220546:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000db5e436b reply state 000000004d239f95 transno 4294970588 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220555:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220559:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff96c2c7e0f300) 00010000:00010000:1.0:1775764785.220566:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764785.220569:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1775764785.220573:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1775764785.220580:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220585:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220589:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220593:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220597:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.220600:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220604:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220610:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.220611:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.220613:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 3/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220616:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed5231de lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764785.220624:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000db5e436b reply state 000000004d239f95 transno 4294970588 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220684:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.220688:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x43454b14 (ffff96c2c7e0f800) 00010000:00010000:1.0:1775764785.220690:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764785.220691:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1775764785.220821:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+27:46261:x1862023076065024:12345-192.168.202.58@tcp:36:mkdir.0 Request processed in 1623us (1857us total) trans 4294970588 rc 0/0 00000100:00100000:1.0:1775764785.220830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6395 00000100:00100000:2.0:1775764785.232107:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.232216:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065152 00000100:00100000:0.0:1775764785.232228:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065152 00000100:00100000:0.0:1775764785.232299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6396 00000100:00100000:0.0:1775764785.232309:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+27:46262:x1862023076065152:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:0.0:1775764785.232333:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764785.232352:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed5231f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5150 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232415:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232430:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232442:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232453:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232460:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232481:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232559:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed523208 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232567:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed523208 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232585:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed523208 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764785.232622:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1775764785.232626:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764785.232660:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed523208 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232676:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232683:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232689:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232695:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232701:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6dc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764785.232705:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232718:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232731:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764785.232733:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764785.232738:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232744:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5231fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232765:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232826:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232833:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232838:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764785.232840:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232846:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232853:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x342303f9 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764785.232856:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764785.232858:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232873:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523201 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232900:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed5231f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5150 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232912:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6da00/0x6e98bd47ed523208 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5150 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.232919:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764785.232921:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1775764785.232923:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6da00, rc 0) 00000100:00100000:0.0:1775764785.232994:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:46262:x1862023076065152:12345-192.168.202.58@tcp:101:bash.0 Request processed in 685us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.233001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6396 00000100:00100000:3.0:1775764785.249645:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.249874:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065280 00000100:00100000:1.0:1775764785.249886:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065280 00000100:00100000:1.0:1775764785.249948:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6397 00000100:00100000:1.0:1775764785.249958:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:46262:x1862023076065280:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:1.0:1775764785.249979:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.250000:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed52320f lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5157 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250068:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250083:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250095:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250111:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250136:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250142:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250186:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250193:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250199:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250207:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.250212:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250220:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250231:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.250234:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.250239:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250246:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523216 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250261:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250273:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250279:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250283:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.250286:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250291:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250298:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f500) 00010000:00010000:1.0:1775764785.250301:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.250303:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250308:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52321d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250343:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed52320f lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5157 expref: 29 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250353:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.250355:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.250359:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed52320f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5157 expref: 29 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.250380:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5400, rc 0) 00000100:00100000:1.0:1775764785.250443:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:46262:x1862023076065280:12345-192.168.202.58@tcp:101:bash.0 Request processed in 487us (810us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764785.250451:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6397 00000100:00100000:3.0:1775764785.260059:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.260173:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065408 00000100:00100000:0.0:1775764785.260182:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065408 00000100:00100000:0.0:1775764785.260255:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6398 00000100:00100000:0.0:1775764785.260265:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:46263:x1862023076065408:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:0.0:1775764785.260293:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764785.260315:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd515e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.260384:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.260399:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.260424:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764785.260469:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1775764785.260473:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764785.260493:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.260515:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 49 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.260534:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.260543:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764785.260545:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764785.260548:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6de00, rc 0) 00000100:00100000:0.0:1775764785.260618:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:46263:x1862023076065408:12345-192.168.202.58@tcp:101:rm.0 Request processed in 355us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.260625:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6398 00000100:00100000:2.0:1775764785.265266:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.265342:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065536 00000100:00100000:1.0:1775764785.265352:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065536 00000100:00100000:1.0:1775764785.265402:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6399 00000100:00100000:1.0:1775764785.265409:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+48:46263:x1862023076065536:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764785.265427:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.265443:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5165 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265516:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265533:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265542:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265550:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265554:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265558:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265652:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523247 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265658:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265662:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764785.265689:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1775764785.265691:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764785.265740:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265750:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265809:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265816:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265821:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265827:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.265830:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265837:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265855:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764785.265858:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.265863:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265869:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265882:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265886:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265890:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265892:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.265894:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265897:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265901:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x342303f9 (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764785.265902:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.265904:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265907:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523240 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265933:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5165 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265941:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5200/0x6e98bd47ed523247 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5165 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.265946:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.265947:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1775764785.265949:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5200, rc 0) 00000100:00100000:1.0:1775764785.266007:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:46263:x1862023076065536:12345-192.168.202.58@tcp:101:rm.0 Request processed in 598us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.266014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6399 00000100:00100000:3.0:1775764785.269048:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.269217:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065664 00000100:00100000:1.0:1775764785.269229:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065664 00000100:00100000:1.0:1775764785.269295:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6400 00000100:00100000:1.0:1775764785.269306:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:46263:x1862023076065664:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764785.269327:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.269351:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52324e lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd516c expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269409:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269420:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269429:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269451:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269456:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269460:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269495:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269501:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269507:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269513:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.269517:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269525:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269537:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.269539:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.269542:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269546:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523255 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269561:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269565:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269568:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269571:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.269581:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269585:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269589:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f500) 00010000:00010000:1.0:1775764785.269590:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.269592:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269596:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed52325c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269623:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52324e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd516c expref: 50 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269868:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.269871:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.269881:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52324e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd516c expref: 50 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.269892:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5e00, rc 0) 00000100:00100000:1.0:1775764785.269954:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:46263:x1862023076065664:12345-192.168.202.58@tcp:101:rm.0 Request processed in 651us (919us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764785.269960:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6400 00000100:00100000:3.0:1775764785.273312:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.273483:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065792 00000100:00100000:1.0:1775764785.273495:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065792 00000100:00100000:1.0:1775764785.273557:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6401 00000100:00100000:1.0:1775764785.273570:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:46263:x1862023076065792:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764785.273603:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.273628:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523263 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5173 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.273948:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.273962:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.273975:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.273989:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.273995:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274002:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274053:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274060:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274066:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274072:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274078:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.274082:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274090:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274103:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.274106:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.274111:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274117:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52326a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274131:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274136:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274147:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274152:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.274155:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274161:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274168:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764785.274170:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.274172:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274177:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523271 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274318:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523263 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5173 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274326:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.274328:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.274330:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523263 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5173 expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.274337:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5400, rc 0) 00000100:00100000:1.0:1775764785.274393:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:46263:x1862023076065792:12345-192.168.202.58@tcp:101:rm.0 Request processed in 826us (1092us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764785.274408:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6401 00000100:00100000:2.0:1775764785.293343:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.293571:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076065920 00000100:00100000:0.0:1775764785.293580:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076065920 00000100:00100000:0.0:1775764785.293702:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6402 00000100:00100000:0.0:1775764785.293712:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+49:46264:x1862023076065920:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764785.293733:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764785.293819:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523278 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd517a expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.293901:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.293915:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.293926:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.293939:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.293946:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.293952:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294002:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294009:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294015:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294021:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6dc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764785.294025:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294041:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294059:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764785.294062:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764785.294066:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294072:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52327f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294084:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294090:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294096:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294101:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764785.294103:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294109:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294114:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2d660f200) 00010000:00010000:0.0:1775764785.294116:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764785.294119:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294132:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed523286 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294170:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523278 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd517a expref: 50 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294179:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764785.294181:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764785.294184:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523278 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd517a expref: 50 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.294192:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d000, rc 0) 00000100:00100000:0.0:1775764785.294256:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+49:46264:x1862023076065920:12345-192.168.202.58@tcp:101:cp.0 Request processed in 544us (922us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764785.294263:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6402 00000100:00100000:3.0:1775764785.297983:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.300326:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076066048 00000100:00100000:1.0:1775764785.300341:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076066048 00000100:00100000:1.0:1775764785.300409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6403 00000100:00100000:1.0:1775764785.300420:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:46264:x1862023076066048:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:1.0:1775764785.300445:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.300466:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed52328d lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5181 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301228:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301246:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301259:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301273:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301279:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301285:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301321:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301347:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301353:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301360:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301366:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.301370:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301378:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301391:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.301394:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.301400:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301406:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523294 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301420:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301427:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301433:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301446:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.301449:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301455:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301463:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764785.301465:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.301468:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301649:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52329b lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301690:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed52328d lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5181 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301701:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.301704:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.301708:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed52328d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5181 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.301717:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5400, rc 0) 00000100:00100000:1.0:1775764785.302347:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:46264:x1862023076066048:12345-192.168.202.58@tcp:101:cp.0 Request processed in 1925us (4381us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764785.302359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6403 00000100:00100000:3.0:1775764785.306583:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.306710:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076066304 00000100:00100000:1.0:1775764785.306734:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076066304 00000100:00100000:1.0:1775764785.306834:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6404 00000100:00100000:1.0:1775764785.306844:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:46264:x1862023076066304:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:1.0:1775764785.306866:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.306888:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5232a2 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5188 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.307291:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.307308:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.307321:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.307334:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.307340:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.307347:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764785.307804:0:10088:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x53:0x0], index 0: 0 00010000:00010000:1.0:1775764785.308397:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308409:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308429:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308466:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308480:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308486:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308492:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764785.308496:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308504:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308517:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764785.308520:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764785.308525:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308531:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed5232a9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764785.308544:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c19e456b reply state 0000000095c2d30a transno 4294970589 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308555:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308568:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f500) 00010000:00010000:1.0:1775764785.308571:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764785.308573:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764785.308613:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5232a2 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 52 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308629:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 51 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.308636:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:1.0:1775764785.308638:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764785.308640:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5a00, rc 0) 00000100:00100000:1.0:1775764785.310580:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:46264:x1862023076066304:12345-192.168.202.58@tcp:101:cp.0 Request processed in 3727us (3998us total) trans 4294970589 rc 0/0 00000100:00100000:1.0:1775764785.310591:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6404 00000100:00100000:3.0:1775764785.315443:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.315945:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076066432 00000100:00100000:0.0:1775764785.315957:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076066432 00000100:00100000:0.0:1775764785.316332:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1688 00000100:00100000:0.0:1775764785.316344:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2409:x1862023076066432:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764785.316365:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764785.316386:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd518f expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764785.316417:0:8641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1775764785.316437:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764785.316440:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764785.316466:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 6 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.316499:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 6 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.316516:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c600, rc 0) 00000100:00100000:0.0:1775764785.316584:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2409:x1862023076066432:12345-192.168.202.58@tcp:101:cp.0 Request processed in 241us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.316591:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1688 00000100:00080000:3.0:1775764785.318092:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764785.321386:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.321479:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076066560 00000100:00100000:3.0:1775764785.321488:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076066560 00000100:00100000:3.0:1775764785.321546:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1689 00000100:00100000:3.0:1775764785.321558:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:46264:x1862023076066560:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764785.321579:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764785.321598:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5196 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.321629:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.321638:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764785.321640:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764785.321644:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 7 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.321680:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.321693:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 7 pid: 8641 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.321708:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099790592:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764785.322146:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764785.329314:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.329508:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076066688 00000100:00100000:0.0:1775764785.329520:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076066688 00010000:00010000:0.0:1775764785.329564:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 8 pid: 8641 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764785.329608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1381 00000100:00100000:0.0:1775764785.329619:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c63bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076066688:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764785.329636:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764785.329662:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 8 pid: 8641 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.329677:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 8 pid: 8641 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.329705:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764785.329723:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764785.329732:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.329742:0:6507:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.330308:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764785.330325:0:6507:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7172a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1862023099790720:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764785.330421:0:6507:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1775764785.333359:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002839cd39/0x6e98bd47ed5232c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd518f expref: 8 pid: 8641 timeout: 1393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.333412:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099790592:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764785.333457:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 7 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.333545:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9000, rc 0) 00000100:00100000:3.0:1775764785.334100:0:6507:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7172a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1862023099790720:192.168.202.58@tcp:105: 00010000:00010000:3.0:1775764785.334114:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764785.334178:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c63bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076066688:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 4560us (4872us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.334188:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1381 00000100:00100000:2.0:1775764785.336004:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:46264:x1862023076066560:12345-192.168.202.58@tcp:101:cp.0 Request processed in 14434us (14613us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764785.336015:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1689 00000100:00100000:0.0:1775764785.340039:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764785.340284:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076066944 00000100:00100000:2.0:1775764785.340294:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076066944 00000100:00100000:2.0:1775764785.340376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1340 00000100:00100000:2.0:1775764785.340387:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dd67ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+52:46264:x1862023076066944:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:2.0:1775764785.340685:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dd67ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+53:46264:x1862023076066944:12345-192.168.202.58@tcp:35:cp.0 Request processed in 299us (657us total) trans 4294970590 rc 0/0 00000100:00100000:2.0:1775764785.340694:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1340 00000100:00100000:1.0:1775764785.398343:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.399138:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076067200 00000100:00100000:3.0:1775764785.399221:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076067200 00000100:00100000:2.0:1775764785.399410:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6405 00000100:00100000:2.0:1775764785.399422:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:46267:x1862023076067200:12345-192.168.202.58@tcp:101:md5sum.0 00010000:00010000:2.0:1775764785.399459:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764785.399492:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5232d3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd519d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399568:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399584:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399596:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399606:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399613:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399620:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399730:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.399738:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400381:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764785.400396:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00010000:00010000:2.0:1775764785.400507:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400516:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400523:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400530:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400536:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764785.400540:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400549:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400563:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:2.0:1775764785.400566:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764785.400570:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400577:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed5232da lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400591:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400598:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400604:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400616:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764785.400619:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400625:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400634:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f500) 00010000:00010000:2.0:1775764785.400636:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764785.400639:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400644:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5232e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400692:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5232d3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400707:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.400714:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:2.0:1775764785.400717:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764785.400719:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0a00, rc 0) 00000100:00100000:2.0:1775764785.400841:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46267:x1862023076067200:12345-192.168.202.58@tcp:101:md5sum.0 Request processed in 1420us (2507us total) trans 4294970591 rc 0/0 00000100:00100000:2.0:1775764785.400850:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6405 00000100:00100000:0.0:1775764785.406727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.406951:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076067328 00000100:00100000:3.0:1775764785.406964:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076067328 00000100:00100000:3.0:1775764785.407043:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1690 00000100:00100000:3.0:1775764785.407063:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076067328:12345-192.168.202.58@tcp:101:md5sum.0 00010000:00010000:3.0:1775764785.407086:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764785.407106:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed5232f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51a4 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.407187:0:15167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15167:1862023099790848:192.168.202.58@tcp:106: 00000100:00100000:3.0:1775764785.407280:0:15167:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20000 going to sleep for 11 seconds 00000100:00080000:0.0:1775764785.407596:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1775764785.410038:0:15167:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1775764785.410045:0:15167:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb mtime: 0 -> 1775764784 00002000:00010000:3.0:1775764785.410072:0:15167:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb atime: 0 -> 1775764784 00002000:00010000:3.0:1775764785.410075:0:15167:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb ctime: 0 -> 1775764784 00002000:00010000:3.0:1775764785.410077:0:15167:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1775764785.410100:0:15167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15167:1862023099790848:192.168.202.58@tcp:106: 00010000:00010000:3.0:1775764785.410282:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed5232f6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51a4 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.410310:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed5232f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51a4 expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.410325:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8600, rc 0) 00000100:00100000:3.0:1775764785.410388:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076067328:12345-192.168.202.58@tcp:101:md5sum.0 Request processed in 3335us (3671us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764785.410397:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1690 00000100:00100000:0.0:1775764785.414686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.415232:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076067456 00000100:00100000:1.0:1775764785.415242:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076067456 00000100:00100000:1.0:1775764785.415340:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1691 00000100:00100000:1.0:1775764785.415351:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:46267:x1862023076067456:12345-192.168.202.58@tcp:101:md5sum.0 00010000:00010000:1.0:1775764785.415370:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.415387:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51ab expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.415421:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 5 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.415450:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1775764785.415452:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1775764785.415457:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.415507:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 5 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.415519:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 5 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764785.415533:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c66a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099790976:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764785.415627:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8838600 going to sleep for 11 seconds 00000100:00100000:3.0:1775764785.419209:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764785.419362:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076067584 00000100:00100000:2.0:1775764785.419381:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076067584 00002000:00100000:2.0:1775764785.419435:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x53:0x0] (0->157) req@ffff96c1c61aea00 x1862023076067584/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:266/0 lens 648/0 e 0 to 0 dl 1775764796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764785.419448:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c61aea00 with x1862023076067584 ext(0->157) 00010000:00010000:2.0:1775764785.419457:0:8409:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 6 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.419484:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 6 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764785.419493:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c61aea00 00000100:00100000:2.0:1775764785.419523:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 31 00000100:00100000:2.0:1775764785.419533:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076067584:12345-192.168.202.58@tcp:4:cp.0 00000100:00100000:1.0:1775764785.420351:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c66a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099790976:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764785.420387:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.420405:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5600, rc 0) 00000100:00100000:1.0:1775764785.420476:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:46267:x1862023076067456:12345-192.168.202.58@tcp:101:md5sum.0 Request processed in 5127us (5798us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.420484:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1691 00000100:00100000:2.0:1775764785.421825:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076067584:12345-192.168.202.58@tcp:4:cp.0 Request processed in 2286us (2618us total) trans 4294967718 rc 0/0 00000100:00100000:2.0:1775764785.421836:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 31 00002000:00100000:2.0:1775764785.421849:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x53:0x0] (0->157) req@ffff96c1c61aea00 x1862023076067584/t4294967718(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:266/0 lens 648/448 e 0 to 0 dl 1775764796 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764785.421860:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c61aea00 with x1862023076067584 ext(0->157) 00010000:00010000:2.0:1775764785.421870:0:8409:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.421886:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764785.421914:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c61aea00 00000100:00100000:3.0:1775764785.426245:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.426401:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076067712 00000100:00100000:0.0:1775764785.426413:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076067712 00010000:00010000:0.0:1775764785.426458:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764785.426512:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1382 00000100:00100000:0.0:1775764785.426523:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076067712:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764785.426538:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1775764785.426556:0:24971:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x53:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1775764785.426563:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.426598:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.426622:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed5232cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5196 expref: 8 pid: 24969 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.426639:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764785.426642:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764785.426650:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.426661:0:24971:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.426701:0:24971:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 6 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764785.426716:0:24971:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7171880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:24971:1862023099791104:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764785.426840:0:24971:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764785.431412:0:24971:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7171880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:24971:1862023099791104:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764785.431439:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764785.431505:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076067712:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 4983us (5267us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.431517:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1382 00000100:00100000:2.0:1775764785.433078:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.433141:0:16794:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076067840 00000100:00100000:1.0:1775764785.433158:0:16794:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076067840 00002000:00100000:1.0:1775764785.433199:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x53:0x0] (0->4095) req@ffff96c2f9934380 x1862023076067840/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:266/0 lens 488/0 e 0 to 0 dl 1775764796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764785.433224:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2f9934380 with x1862023076067840 ext(0->4095) 00002000:00010000:1.0:1775764785.433229:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c2f9934380 00000100:00100000:1.0:1775764785.433256:0:16794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 426 00000100:00100000:1.0:1775764785.433265:0:16794:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076067840:12345-192.168.202.58@tcp:3:md5sum.0 00000100:00100000:1.0:1775764785.433413:0:16794:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076067840:12345-192.168.202.58@tcp:3:md5sum.0 Request processed in 149us (340us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1775764785.433421:0:16794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 426 00002000:00100000:1.0:1775764785.433426:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x53:0x0] (0->4095) req@ffff96c2f9934380 x1862023076067840/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:266/0 lens 488/4536 e 0 to 0 dl 1775764796 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764785.433434:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2f9934380 with x1862023076067840 ext(0->4095) 00002000:00010000:1.0:1775764785.433437:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c2f9934380 00000100:00100000:3.0:1775764785.437973:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.440038:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076068096 00000100:00100000:0.0:1775764785.440273:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076068096 00000100:00100000:0.0:1775764785.440406:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1341 00000100:00100000:0.0:1775764785.440417:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46267:x1862023076068096:12345-192.168.202.58@tcp:35:md5sum.0 00000100:00100000:0.0:1775764785.440743:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:46267:x1862023076068096:12345-192.168.202.58@tcp:35:md5sum.0 Request processed in 326us (2777us total) trans 4294970592 rc 0/0 00000100:00100000:0.0:1775764785.440767:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1341 00000100:00100000:3.0:1775764785.459895:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.460023:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076068224 00000100:00100000:0.0:1775764785.460035:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076068224 00000100:00100000:0.0:1775764785.460104:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6406 00000100:00100000:0.0:1775764785.460114:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:46268:x1862023076068224:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764785.460140:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764785.460170:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51b2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.460234:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52330b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.460248:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52330b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.460259:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52330b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764785.460298:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1775764785.460302:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764785.460321:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52330b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.460345:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51b2 expref: 33 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.460374:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52330b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51b2 expref: 32 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764785.460382:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764785.460385:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764785.460388:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ce00, rc 0) 00000100:00100000:0.0:1775764785.460450:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46268:x1862023076068224:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 337us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.460457:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6406 00000100:00100000:2.0:1775764785.468690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.468821:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076068480 00000100:00100000:0.0:1775764785.468832:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076068480 00000100:00100000:0.0:1775764785.468890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6407 00000100:00100000:0.0:1775764785.468899:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46268:x1862023076068480:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:0.0:1775764785.469096:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].147, 136 off27976 00000100:00100000:0.0:1775764785.469180:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46268:x1862023076068480:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 282us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.469188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6407 00000040:00080000:1.0:1775764785.650082:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764785.650091:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764785.650319:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 148 count 4 00000040:00080000:1.0:1775764785.650328:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764785.650553:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c66a8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099791232:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764785.650658:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8838540 going to sleep for 11 seconds 00000100:00100000:2.0:1775764785.654911:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.655507:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076068608 00000100:00100000:3.0:1775764785.655518:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076068608 00000100:00100000:3.0:1775764785.655579:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6408 00000100:00100000:3.0:1775764785.655588:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076068608:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764785.655627:0:10088:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764785.655746:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076068608:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 159us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.655764:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6408 00000100:00100000:1.0:1775764785.656643:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c66a8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099791232:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764785.671374:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.671492:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076068864 00000100:00100000:1.0:1775764785.671502:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076068864 00000100:00100000:1.0:1775764785.671559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6409 00000100:00100000:1.0:1775764785.671569:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c49e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+53:46278:x1862023076068864:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764785.671591:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.671620:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523312 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51b9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.671731:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523319 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.671746:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523319 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.671768:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523319 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764785.671801:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00010000:00010000:1.0:1775764785.671910:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523312 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51b9 expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.671927:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523319 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51b9 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.671936:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:1.0:1775764785.671939:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764785.671944:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5400, rc 0) 00000100:00100000:1.0:1775764785.672019:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c49e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076068864:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 452us (654us total) trans 4294970593 rc 0/0 00000100:00100000:1.0:1775764785.672027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6409 00000100:00100000:3.0:1775764785.693101:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.693150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.693180:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076068992 00000100:00100000:3.0:1775764785.693191:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076068992 00000100:00100000:3.0:1775764785.693257:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 741 00000100:00100000:3.0:1775764785.693268:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:2408:x1862023076068992:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764785.693285:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764785.693312:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523319 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51b9 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693330:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:3.0:1775764785.693336:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764785.693398:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+54:2408:x1862023076068992:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.693406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 741 00000100:00100000:3.0:1775764785.693447:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076069120 00000100:00100000:3.0:1775764785.693451:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076069120 00000100:00100000:3.0:1775764785.693477:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1692 00000100:00100000:3.0:1775764785.693484:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076069120:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764785.693523:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693537:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764785.693539:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764785.693544:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693557:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693593:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693601:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693609:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693616:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764785.693621:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693630:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693641:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.693648:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523327 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.693685:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076069120:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 201us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.693692:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1692 00000100:00100000:2.0:1775764785.699562:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.699742:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076069376 00000100:00100000:1.0:1775764785.699760:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076069376 00000100:00100000:1.0:1775764785.699838:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6410 00000100:00100000:1.0:1775764785.699846:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c49e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076069376:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1775764785.699951:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c49e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076069376:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 106us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.699957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6410 00000100:00100000:3.0:1775764785.714027:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.714094:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076069504 00000100:00100000:1.0:1775764785.714104:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076069504 00000100:00100000:1.0:1775764785.714152:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1693 00000100:00100000:1.0:1775764785.714160:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076069504:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764785.714177:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764785.714193:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51c0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.714221:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764785.714224:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764785.714232:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.714252:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764785.714267:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4e00, rc 0) 00000100:00100000:1.0:1775764785.714336:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076069504:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 175us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764785.714343:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1693 00000100:00100000:3.0:1775764785.728649:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.728713:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076069760 00000100:00100000:0.0:1775764785.728722:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076069760 00000100:00100000:0.0:1775764785.728819:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6411 00000100:00100000:0.0:1775764785.728830:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076069760:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764785.728930:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076069760:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.728936:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6411 00000100:00100000:3.0:1775764785.732079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764785.732139:0:8408:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076069888 00000100:00100000:0.0:1775764785.732147:0:8408:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076069888 00002000:00100000:0.0:1775764785.732187:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x53:0x0] (0->4095) req@ffff96c1c73f3100 x1862023076069888/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:266/0 lens 488/0 e 0 to 0 dl 1775764796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764785.732197:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c73f3100 with x1862023076069888 ext(0->4095) 00002000:00010000:0.0:1775764785.732204:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c73f3100 00000100:00100000:0.0:1775764785.732233:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 427 00000100:00100000:0.0:1775764785.732242:0:8408:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076069888:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1775764785.732424:0:8408:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076069888:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 183us (354us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1775764785.732430:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 427 00002000:00100000:0.0:1775764785.732434:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x53:0x0] (0->4095) req@ffff96c1c73f3100 x1862023076069888/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:266/0 lens 488/4536 e 0 to 0 dl 1775764796 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764785.732440:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c73f3100 with x1862023076069888 ext(0->4095) 00002000:00010000:0.0:1775764785.732442:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c73f3100 00000100:00100000:3.0:1775764785.745875:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764785.746004:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076070016 00000100:00100000:2.0:1775764785.746012:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076070016 00000100:00100000:2.0:1775764785.746067:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6412 00000100:00100000:2.0:1775764785.746075:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:46278:x1862023076070016:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764785.746092:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764785.746109:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523335 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51c7 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.746140:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.746152:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.746160:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.746319:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523335 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 56 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.746336:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.746355:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:2.0:1775764785.746358:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764785.746363:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0000, rc 0) 00000100:00100000:2.0:1775764785.746443:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076070016:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 367us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764785.746450:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6412 00000100:00100000:0.0:1775764785.761284:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.761394:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076070144 00000100:00100000:3.0:1775764785.761405:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076070144 00000100:00100000:3.0:1775764785.761498:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6413 00000100:00100000:3.0:1775764785.761510:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076070144:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764785.761543:0:14288:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764785.761699:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076070144:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 191us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.761706:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6413 00000100:00100000:0.0:1775764785.764573:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764785.764664:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076070272 00000100:00100000:3.0:1775764785.764672:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076070272 00000100:00100000:3.0:1775764785.764736:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1694 00000100:00100000:3.0:1775764785.764745:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076070272:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764785.764840:0:8641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764855:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764785.764856:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764785.764860:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764873:0:8641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764914:0:8641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764920:0:8641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764925:0:8641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764930:0:8641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764785.764933:0:8641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764940:0:8641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764950:0:8641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.764954:0:8641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523343 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.765019:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076070272:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 276us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764785.765025:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1694 00000100:00100000:0.0:1775764785.767423:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764785.767600:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076070528 00000100:00100000:2.0:1775764785.767611:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076070528 00000100:00100000:2.0:1775764785.767708:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6414 00000100:00100000:2.0:1775764785.767719:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076070528:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1775764785.767850:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.767867:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.767876:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.767911:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.767925:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 55 pid: 10681 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764785.767940:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff90d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099791360:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764785.768044:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c14c96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764785.770243:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff90d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099791360:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764785.770271:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764785.774156:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764785.774319:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076070656 00000100:00100000:2.0:1775764785.774332:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076070656 00010000:00010000:2.0:1775764785.774379:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 56 pid: 10681 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764785.774466:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1383 00000100:00100000:2.0:1775764785.774481:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076070656:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764785.774498:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764785.774506:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 56 pid: 10681 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.774520:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 56 pid: 10681 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.774542:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed52333c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c7 expref: 56 pid: 10681 timeout: 1393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.774559:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:2.0:1775764785.774563:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.774573:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.774580:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764785.774612:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764785.774685:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+55:2411:x1862023076070656:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 205us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764785.774693:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1383 00010000:00010000:3.0:1775764785.774741:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.774768:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.774961:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.774969:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.774976:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.774982:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764785.774987:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.774995:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.775005:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:3.0:1775764785.775009:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764785.775013:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764785.775019:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52334a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764785.775124:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076070528:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 7407us (7712us total) trans 4294970594 rc 0/0 00000100:00100000:3.0:1775764785.775134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6414 00000040:00080000:1.0:1775764785.775941:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764785.775947:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764785.776422:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1775764785.776443:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764785.779275:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764785.780005:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076070912 00000100:00100000:1.0:1775764785.780021:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076070912 00000100:00100000:1.0:1775764785.781837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1342 00000100:00100000:1.0:1775764785.781856:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:46278:x1862023076070912:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764785.782068:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:46278:x1862023076070912:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 220us (2805us total) trans 4294970595 rc 0/0 00000100:00100000:1.0:1775764785.782076:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1342 00000100:00100000:2.0:1775764785.977354:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099791488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764785.977424:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764785.977508:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099791488 00000100:00100000:0.0:1775764785.977518:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099791488 00000100:00100000:0.0:1775764785.977593:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1775764785.977602:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099791488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1775764785.977630:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444241408 avail 1298001920 00000100:00100000:0.0:1775764785.988452:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099791488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10841us (11017us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764785.988480:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1775764785.988846:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099791488:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1775764786.034259:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764786.034268:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764786.037588:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764786.037607:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1775764786.042284:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764786.446485:0:29924:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764786.446494:0:29924:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764786.446541:0:29924:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 148 count 4 00000040:00080000:2.0:1775764786.446547:0:29924:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764786.543183:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.543482:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076071168 00000100:00100000:1.0:1775764786.543494:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076071168 00000100:00100000:1.0:1775764786.543559:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6415 00000100:00100000:1.0:1775764786.543570:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46279:x1862023076071168:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764786.543592:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764786.543614:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523351 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51ce expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.543732:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523358 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.543758:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523358 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.543797:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523358 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764786.543811:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00010000:00010000:1.0:1775764786.543919:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523351 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ce expref: 35 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.543958:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523358 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ce expref: 34 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.543968:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:1.0:1775764786.543971:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1775764786.543974:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4400, rc 0) 00000100:00100000:1.0:1775764786.544026:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46279:x1862023076071168:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 458us (852us total) trans 4294970596 rc 0/0 00000100:00100000:1.0:1775764786.544034:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6415 00000100:00100000:0.0:1775764786.559718:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.560009:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076071296 00000100:00100000:3.0:1775764786.560023:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076071296 00000100:00100000:3.0:1775764786.560100:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1695 00000100:00100000:3.0:1775764786.560111:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076071296:12345-192.168.202.58@tcp:1:lfs.0 00010000:00010000:3.0:1775764786.560159:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.560179:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.560188:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.560194:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.560197:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.560200:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.560364:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.560397:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 7 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.560413:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099791616:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764786.560625:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 7 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.560634:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 7 pid: 8402 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.560645:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c852b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099791744:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764786.560669:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1775764786.568534:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099791616:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764786.568551:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c852b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099791744:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764786.568581:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.575572:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.575620:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.575944:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076071424 00000100:00100000:3.0:1775764786.575955:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076071424 00010000:00010000:3.0:1775764786.575997:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 8 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.576037:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076071552 00000100:00100000:3.0:1775764786.576049:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076071552 00010000:00010000:3.0:1775764786.576062:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 8 pid: 8402 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.576085:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1384 00000100:00100000:3.0:1775764786.576093:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076071424:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764786.576126:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764786.576148:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 8 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576163:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 8 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576192:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52332e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51c0 expref: 8 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576211:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764786.576412:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076071424:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 319us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.576420:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1384 00000100:00100000:3.0:1775764786.576436:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1385 00000100:00100000:3.0:1775764786.576443:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076071552:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764786.576451:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764786.576611:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 8 pid: 8402 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576623:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 8 pid: 8402 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576641:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002689c4d8/0x6e98bd47ed5232fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ab expref: 8 pid: 8402 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576664:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.576667:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.576671:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576681:0:6507:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.576704:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764786.576725:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076071552:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 283us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.576731:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1385 00010000:00010000:0.0:1775764786.578655:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578675:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578702:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578711:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578719:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578727:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764786.578750:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578766:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578813:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.578820:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b832b9c4/0x6e98bd47ed523366 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.578915:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076071296:12345-192.168.202.58@tcp:1:lfs.0 Request processed in 18801us (19203us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.578926:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1695 00000100:00100000:0.0:1775764786.588018:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.591582:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076071808 00000100:00100000:2.0:1775764786.591598:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076071808 00000100:00100000:2.0:1775764786.591711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1343 00000100:00100000:2.0:1775764786.591723:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46279:x1862023076071808:12345-192.168.202.58@tcp:35:lfs.0 00000004:00010000:2.0:1775764786.591831:0:6525:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x200000403:0x9b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523358 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ce expref: 34 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1775764786.592030:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970597 00000001:00080000:2.0:1775764786.593408:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970598 00010000:00010000:2.0:1775764786.593454:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.593693:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 55 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.593718:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.593728:0:6525:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 5/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.593806:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.593822:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 37 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.593838:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4c95180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099791872:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764786.593948:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 55 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.593956:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 55 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.593965:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c55b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099792000:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764786.593989:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c14c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1775764786.609042:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.609104:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.609140:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076071936 00000100:00100000:0.0:1775764786.609149:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076071936 00010000:00010000:0.0:1775764786.609188:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 38 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.609220:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076072064 00000100:00100000:0.0:1775764786.609224:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076072064 00010000:00010000:0.0:1775764786.609237:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 56 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.609273:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1386 00000100:00100000:0.0:1775764786.609283:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5595880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:2411:x1862023076071936:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764786.609301:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764786.609309:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 38 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609322:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 38 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609347:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:0.0:1775764786.609352:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609360:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609366:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764786.609421:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5595880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:2411:x1862023076071936:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 139us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.609430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1386 00000100:00100000:0.0:1775764786.609447:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1387 00000100:00100000:0.0:1775764786.609453:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076072064:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764786.609461:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764786.609465:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 56 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609485:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 56 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609497:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:0.0:1775764786.609500:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609507:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609514:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.609531:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764786.609551:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076072064:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 98us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.609557:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1387 00010000:00010000:2.0:1775764786.610027:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5232e8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd519d expref: 37 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.610053:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4c95180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099791872:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764786.610076:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5232b7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5188 expref: 55 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.610087:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c55b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099792000:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764786.610109:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.610117:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.610123:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1775764786.610229:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970599 00000001:00080000:2.0:1775764786.610337:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970600 00000100:00100000:2.0:1775764786.610423:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c55b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099792128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1775764786.610470:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764786.610504:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d88386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764786.611391:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099792128 00000100:00100000:0.0:1775764786.611401:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099792128 00000100:00100000:0.0:1775764786.611453:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1775764786.611472:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099792128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764786.611568:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099792128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.611574:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00080000:0.0:1775764786.611593:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764786.611623:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c55b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099792128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1775764786.611739:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970601 00000100:00100000:0.0:1775764786.611839:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5595880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099792256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764786.611868:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764786.611885:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0a540 going to sleep for 11 seconds 00000100:00100000:0.0:1775764786.611899:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099792256 00000100:00100000:0.0:1775764786.611902:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099792256 00000100:00100000:0.0:1775764786.611923:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:0.0:1775764786.611928:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099792256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1775764786.612029:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1862023099792256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (159us total) trans 4294967719 rc 0/0 00000100:00100000:0.0:1775764786.612035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:0.0:1775764786.612446:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5595880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099792256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1775764786.612488:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970602 00010000:00010000:0.0:1775764786.612515:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.612523:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.612529:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.612535:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764786.612540:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.612547:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.612561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:0.0:1775764786.612571:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1775764786.612576:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.612582:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52336d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1775764786.612678:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000405:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1775764786.612738:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].67, 64 off13320 00000004:00080000:0.0:1775764786.612764:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1294433991677ns, next at 1295433988910ns, rc = 0 00000001:00080000:0.0:1775764786.612796:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970603 00010000:00010000:0.0:1775764786.612820:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0f900) 00010000:00010000:0.0:1775764786.612823:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1775764786.612829:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523358 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ce expref: 41 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.612926:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46279:x1862023076071808:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 21205us (24920us total) trans 4294970604 rc 0/0 00000100:00100000:0.0:1775764786.612935:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1343 00000020:00080000:0.0:1775764786.612939:0:6525:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1775764786.637376:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.637635:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076072320 00000100:00100000:1.0:1775764786.637645:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076072320 00000100:00100000:1.0:1775764786.637701:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6416 00000100:00100000:1.0:1775764786.637711:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46280:x1862023076072320:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:1.0:1775764786.637735:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764786.637738:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1775764786.637805:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52330b lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51b2 expref: 40 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.637827:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764786.637833:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764786.637846:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523374 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51d5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.637948:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.637979:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.637990:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638005:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0xc9365186 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638011:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638016:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764786.638381:0:6523:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x54:0x0], index 1: 0 00010000:00010000:1.0:1775764786.638535:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523389 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638544:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523389 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638551:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523389 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638585:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638592:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638598:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638612:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638618:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.638622:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638629:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638638:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764786.638642:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764786.638645:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 3/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638651:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52337b lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764786.638662:0:6523:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b704e08c reply state 000000004fe19c3b transno 4294970605 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638672:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638677:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0xc9365186 (ffff96c2c7e0fc00) 00010000:00010000:1.0:1775764786.638679:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764786.638682:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764786.638712:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523374 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51d5 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638725:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5400/0x6e98bd47ed523389 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51d5 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.638738:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff96c2c7e0f100) 00010000:00010000:1.0:1775764786.638740:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764786.638751:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5400, rc 0) 00000100:00100000:1.0:1775764786.638877:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:46280:x1862023076072320:12345-192.168.202.58@tcp:101:tar.0 Request processed in 1166us (1510us total) trans 4294970605 rc 0/0 00000100:00100000:1.0:1775764786.638887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6416 00000100:00100000:0.0:1775764786.649889:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.649982:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076072448 00000100:00100000:3.0:1775764786.649993:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076072448 00000100:00100000:3.0:1775764786.650075:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1696 00000100:00100000:3.0:1775764786.650087:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076072448:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764786.650109:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.650133:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51dc expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764786.650162:0:8403:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1775764786.650183:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.650185:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.650194:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.650245:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.650260:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8600, rc 0) 00000100:00100000:3.0:1775764786.650313:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076072448:12345-192.168.202.58@tcp:101:tar.0 Request processed in 228us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.650321:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1696 00000100:00080000:2.0:1775764786.651953:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764786.660122:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.660579:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076072704 00000100:00100000:3.0:1775764786.660591:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076072704 00000100:00100000:3.0:1775764786.660683:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6417 00000100:00100000:3.0:1775764786.660694:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:46280:x1862023076072704:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764786.660722:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.660752:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52339e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51e3 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764786.660912:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1775764786.661026:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52339e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51e3 expref: 44 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.661056:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764786.661059:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1775764786.661065:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52339e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51e3 expref: 44 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.661077:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764786.661149:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46280:x1862023076072704:12345-192.168.202.58@tcp:101:tar.0 Request processed in 457us (1117us total) trans 4294970606 rc 301/301 00000100:00100000:3.0:1775764786.661157:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6417 00000100:00100000:0.0:1775764786.676739:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.682210:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076072832 00000100:00100000:3.0:1775764786.682232:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076072832 00000100:00100000:2.0:1775764786.682530:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6418 00000100:00100000:2.0:1775764786.682543:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46280:x1862023076072832:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:2.0:1775764786.682584:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764786.682620:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233ac lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.682716:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.682735:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.682980:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.682997:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683005:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683011:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683260:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683269:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683276:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764786.683386:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00000004:00200000:2.0:1775764786.683392:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764786.683418:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683431:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683441:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683520:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683526:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683532:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683538:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.683543:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683551:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683565:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:2.0:1775764786.683567:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764786.683572:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683578:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5233b3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683589:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683595:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683601:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683611:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.683614:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683619:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683627:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f500) 00010000:00010000:2.0:1775764786.683629:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764786.683632:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683637:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5233ba lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683672:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233ac lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ea expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683687:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ea expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.683693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764786.683696:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764786.683698:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0600, rc 0) 00000100:00100000:2.0:1775764786.683822:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:46280:x1862023076072832:12345-192.168.202.58@tcp:101:tar.0 Request processed in 1281us (7092us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.683831:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6418 00000100:00100000:2.0:1775764786.708234:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.708319:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076072960 00000100:00100000:3.0:1775764786.708331:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076072960 00000100:00100000:3.0:1775764786.708395:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6419 00000100:00100000:3.0:1775764786.708405:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:46280:x1862023076072960:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764786.708427:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.708448:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51f1 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.708494:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 45 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.708509:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 45 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.708519:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:3.0:1775764786.708522:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764786.708526:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764786.708584:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:46280:x1862023076072960:12345-192.168.202.58@tcp:101:tar.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.708591:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6419 00000100:00100000:0.0:1775764786.718397:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.718625:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076073088 00000100:00100000:3.0:1775764786.718637:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076073088 00000100:00100000:3.0:1775764786.718704:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1344 00000100:00100000:3.0:1775764786.718728:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:46280:x1862023076073088:12345-192.168.202.58@tcp:37:tar.0 00000100:00100000:1.0:1775764786.722569:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:46280:x1862023076073088:12345-192.168.202.58@tcp:37:tar.0 Request processed in 3834us (4176us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.722583:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1344 00000100:00100000:1.0:1775764786.726313:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.727253:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076073344 00000100:00100000:3.0:1775764786.727266:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076073344 00000100:00100000:3.0:1775764786.727342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6420 00000100:00100000:3.0:1775764786.727354:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:46280:x1862023076073344:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764786.727382:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.727409:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5233cf lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51f8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.727546:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5233d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.727563:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5233d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.727575:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5233d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764786.727588:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00010000:00010000:3.0:1775764786.727717:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5233cf lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f8 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.727737:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5233d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f8 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.727767:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:3.0:1775764786.727942:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764786.727947:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764786.728666:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:46280:x1862023076073344:12345-192.168.202.58@tcp:101:tar.0 Request processed in 1308us (2355us total) trans 4294970607 rc 0/0 00000100:00100000:3.0:1775764786.728683:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6420 00000100:00100000:1.0:1775764786.739885:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.739939:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.740032:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076073472 00000100:00100000:3.0:1775764786.740051:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076073472 00000100:00100000:3.0:1775764786.740112:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6421 00000100:00100000:3.0:1775764786.740122:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:46280:x1862023076073472:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764786.740147:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.740170:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5233e4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd51ff expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.740203:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.740216:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.740227:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.740331:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5233e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 49 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.740347:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.740355:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:3.0:1775764786.740357:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764786.740361:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9c00, rc 0) 00000100:00100000:3.0:1775764786.740418:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:46280:x1862023076073472:12345-192.168.202.58@tcp:101:tar.0 Request processed in 298us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.740430:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6421 00000100:00100000:2.0:1775764786.741239:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076073600 00000100:00100000:2.0:1775764786.741247:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076073600 00000100:00100000:2.0:1775764786.741300:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 742 00000100:00100000:2.0:1775764786.741307:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:2410:x1862023076073600:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764786.741320:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764786.741339:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5233d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f8 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.741353:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764786.741356:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764786.741399:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:2410:x1862023076073600:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 92us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.741406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 742 00000100:00100000:1.0:1775764786.758521:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.758633:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076073856 00000100:00100000:2.0:1775764786.758645:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076073856 00000100:00100000:2.0:1775764786.758721:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 743 00000100:00100000:2.0:1775764786.758733:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:46280:x1862023076073856:12345-192.168.202.58@tcp:103:tar.0 00010000:00010000:2.0:1775764786.758795:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764786.758824:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5233c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ea expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.758844:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764786.758850:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764786.758913:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:46280:x1862023076073856:12345-192.168.202.58@tcp:103:tar.0 Request processed in 183us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.758920:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 743 00000100:00100000:1.0:1775764786.767536:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.771738:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076073984 00000100:00100000:3.0:1775764786.771789:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076073984 00000100:00100000:3.0:1775764786.771866:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6422 00000100:00100000:3.0:1775764786.771876:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:46280:x1862023076073984:12345-192.168.202.58@tcp:58:tar.0 00010000:00010000:3.0:1775764786.771994:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.772015:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.772027:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1775764786.772130:0:10088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].148, 136 off28112 00000100:00100000:3.0:1775764786.772218:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:46280:x1862023076073984:12345-192.168.202.58@tcp:58:tar.0 Request processed in 343us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.772226:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6422 00000100:00100000:1.0:1775764786.781032:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.781445:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076074112 00000100:00100000:2.0:1775764786.781477:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076074112 00000100:00100000:2.0:1775764786.781534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6423 00000100:00100000:2.0:1775764786.781544:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:46280:x1862023076074112:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:2.0:1775764786.781565:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764786.781586:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5206 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.781651:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.781661:0:6523:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.781681:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.781693:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.781706:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764786.781709:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764786.781713:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.781721:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0a00, rc 0) 00000100:00100000:2.0:1775764786.781809:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:46280:x1862023076074112:12345-192.168.202.58@tcp:101:tar.0 Request processed in 266us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.781816:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6423 00000040:00080000:2.0:1775764786.805234:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764786.805243:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764786.805267:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 149 count 5 00000040:00080000:2.0:1775764786.805275:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764786.805420:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099792384:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764786.805539:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8838000 going to sleep for 11 seconds 00000100:00100000:3.0:1775764786.809631:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.809671:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076074240 00000100:00100000:3.0:1775764786.809681:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076074240 00000100:00100000:3.0:1775764786.809733:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6424 00000100:00100000:3.0:1775764786.809754:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c852b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+56:46281:x1862023076074240:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764786.809815:0:6522:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764786.809925:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c852b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+56:46281:x1862023076074240:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 183us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.809933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6424 00000100:00100000:2.0:1775764786.811118:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099792384:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1775764786.812875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.813419:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076074368 00000100:00100000:2.0:1775764786.813429:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076074368 00000100:00100000:2.0:1775764786.813495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6425 00000100:00100000:2.0:1775764786.813505:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:46281:x1862023076074368:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1775764786.813580:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813598:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813610:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813626:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813632:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813639:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813662:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813684:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813692:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764786.813735:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00000004:00200000:2.0:1775764786.813750:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764786.813766:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813801:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813807:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813813:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813819:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813825:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.813829:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813837:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813848:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764786.813857:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764786.813862:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813868:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523400 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813882:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813888:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813894:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813898:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.813901:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813906:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813914:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x48ef5b24 (ffff96c1c4135500) 00010000:00010000:2.0:1775764786.813916:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764786.813919:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813923:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed523407 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x48ef5b24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813936:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813947:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813953:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813958:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.813960:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813966:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813974:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764786.813976:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764786.813979:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.813983:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed52340e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.814419:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:46281:x1862023076074368:12345-192.168.202.58@tcp:34:lhsmtool_posix.0 Request processed in 914us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.814429:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6425 00000100:00100000:3.0:1775764786.819886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.819956:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076074624 00000100:00100000:1.0:1775764786.819967:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076074624 00000100:00100000:1.0:1775764786.820022:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6426 00000100:00100000:1.0:1775764786.820032:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:46281:x1862023076074624:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764786.820061:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764786.820080:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523415 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd520d expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820183:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820213:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820226:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764786.820241:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00010000:00010000:1.0:1775764786.820325:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820332:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820337:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820342:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.820346:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820355:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820366:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:1.0:1775764786.820369:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764786.820373:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820378:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52341c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820427:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523415 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd520d expref: 57 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820436:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:1.0:1775764786.820438:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1775764786.820441:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523415 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd520d expref: 57 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.820448:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5600, rc 0) 00000100:00100000:1.0:1775764786.820717:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+56:46281:x1862023076074624:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 686us (840us total) trans 4294970608 rc 301/301 00000100:00100000:1.0:1775764786.820725:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6426 00000100:00100000:3.0:1775764786.824338:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.826654:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076074752 00000100:00100000:0.0:1775764786.826668:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076074752 00000100:00100000:1.0:1775764786.827397:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6427 00000100:00100000:1.0:1775764786.827408:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+56:46281:x1862023076074752:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764786.827445:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9b:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764786.827581:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+56:46281:x1862023076074752:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 175us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.827589:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6427 00000100:00100000:0.0:1775764786.835389:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.835653:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076075008 00000100:00100000:3.0:1775764786.835665:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076075008 00000100:00100000:3.0:1775764786.835763:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6428 00000100:00100000:3.0:1775764786.835797:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:46281:x1862023076075008:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764786.835822:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.835846:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52342a lrc: 2/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5214 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.836302:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523431 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.836319:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523431 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.836330:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523431 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764786.836341:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9c:0x0]: returning size 0 00010000:00010000:3.0:1775764786.836384:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52342a lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5214 expref: 59 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.836401:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523431 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5214 expref: 58 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.836410:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c1c2b83200) 00010000:00010000:3.0:1775764786.836413:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764786.836431:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764786.836638:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+58:46281:x1862023076075008:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 866us (1258us total) trans 4294970609 rc 0/0 00000100:00100000:3.0:1775764786.836647:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6428 00000100:00100000:2.0:1775764786.840288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.840382:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076075264 00000100:00100000:1.0:1775764786.840392:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076075264 00000100:00100000:1.0:1775764786.840538:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6429 00000100:00100000:1.0:1775764786.840548:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+58:46281:x1862023076075264:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1775764786.840611:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764786.840640:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523431 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5214 expref: 58 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.840673:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c1c2b83200) 00010000:00010000:1.0:1775764786.840685:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764786.840708:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.840723:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.840732:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 4/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.840972:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.840986:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 46 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764786.841001:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099792512:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764786.841169:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c2c17300 going to sleep for 11 seconds 00000100:00100000:3.0:1775764786.843670:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.844181:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099792512:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764786.844220:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.844355:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076075392 00000100:00100000:0.0:1775764786.844362:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076075392 00010000:00010000:0.0:1775764786.844397:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 47 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.844544:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1388 00000100:00100000:0.0:1775764786.844554:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:2411:x1862023076075392:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764786.844573:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764786.844581:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 47 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.844592:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 47 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.844614:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5233c8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51f1 expref: 47 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.844630:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764786.844634:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.844643:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.844651:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.844678:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764786.844732:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:2411:x1862023076075392:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 179us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.844748:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1388 00010000:00010000:1.0:1775764786.845082:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845090:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845118:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845128:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845136:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845180:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845187:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845194:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845199:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845204:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.845208:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845215:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845224:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764786.845226:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764786.845230:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 3/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845241:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52343f lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845251:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845257:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845263:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845267:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.845270:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845275:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845282:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x23a8e9b4 (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764786.845284:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764786.845287:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 2/0,0 mode: --/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.845291:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523446 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xa:0x0].0x23a8e9b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764786.845348:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+57:46281:x1862023076075264:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 4800us (5070us total) trans 0 rc -2/-2 00000100:00100000:1.0:1775764786.845355:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6429 00000100:00100000:3.0:1775764786.848130:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.848194:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076075520 00000100:00100000:1.0:1775764786.848203:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076075520 00000100:00100000:1.0:1775764786.848265:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6430 00000100:00100000:1.0:1775764786.848275:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+57:46281:x1862023076075520:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764786.848296:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764786.848319:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52344d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd521b expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.848352:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.848365:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.848376:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.848500:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed52344d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 59 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.848520:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 58 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.848528:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:1.0:1775764786.848531:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1775764786.848533:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4800, rc 0) 00000100:00100000:1.0:1775764786.848595:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+58:46281:x1862023076075520:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 322us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.848602:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6430 00000100:00100000:2.0:1775764786.851695:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.851818:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076075776 00000100:00100000:1.0:1775764786.851830:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076075776 00000100:00100000:1.0:1775764786.851882:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6431 00000100:00100000:1.0:1775764786.851892:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+58:46281:x1862023076075776:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1775764786.851984:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.852001:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.852013:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764786.852177:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c6fceba4 reply state 000000003c506970 transno 4294970610 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.852190:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.852198:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:1.0:1775764786.852200:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1775764786.852205:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764786.852316:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+60:46281:x1862023076075776:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 425us (632us total) trans 4294970610 rc 0/0 00000100:00100000:1.0:1775764786.852324:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6431 00000100:00100000:2.0:1775764786.855624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.855709:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076075904 00000100:00100000:3.0:1775764786.855719:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076075904 00000100:00100000:3.0:1775764786.855901:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6432 00000100:00100000:3.0:1775764786.855912:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+60:46281:x1862023076075904:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764786.855940:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.855961:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5222 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.856021:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 61 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.856037:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 61 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.856170:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764786.856173:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1775764786.856176:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764786.856274:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+61:46281:x1862023076075904:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 364us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.856281:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6432 00000100:00100000:0.0:1775764786.872350:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.872439:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076076032 00000100:00100000:2.0:1775764786.872450:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076076032 00000100:00100000:2.0:1775764786.872523:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1345 00000100:00100000:2.0:1775764786.872540:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df702c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+61:46281:x1862023076076032:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1775764786.872673:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df702c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+61:46281:x1862023076076032:12345-192.168.202.58@tcp:49:lhsmtool_posix.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.872680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1345 00000100:00100000:2.0:1775764786.876059:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.876260:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076076288 00000100:00100000:1.0:1775764786.876270:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076076288 00000100:00100000:1.0:1775764786.876371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1346 00000100:00100000:1.0:1775764786.876382:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+61:46281:x1862023076076288:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764786.877255:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+62:46281:x1862023076076288:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 257us (597us total) trans 4294970611 rc 0/0 00000100:00100000:1.0:1775764786.877281:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1346 00000100:00100000:3.0:1775764786.879855:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.880672:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076076544 00000100:00100000:0.0:1775764786.880684:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076076544 00000100:00100000:0.0:1775764786.880750:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6433 00000100:00100000:0.0:1775764786.880761:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+62:46281:x1862023076076544:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764786.880917:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+62:46281:x1862023076076544:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 157us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.880926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6433 00000100:00100000:0.0:1775764786.885722:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.885886:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076076800 00000100:00100000:3.0:1775764786.885897:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076076800 00000100:00100000:3.0:1775764786.885954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6434 00000100:00100000:3.0:1775764786.885964:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+62:46281:x1862023076076800:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764786.885985:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.886004:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523469 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5229 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.886139:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.886154:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 63 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.886163:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.886192:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 63 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.886201:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 63 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.886211:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099792640:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764786.886279:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20240 going to sleep for 11 seconds 00000100:00100000:2.0:1775764786.890909:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.891046:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076076928 00000100:00100000:0.0:1775764786.891055:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076076928 00010000:00010000:0.0:1775764786.891095:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 64 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.891134:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1389 00000100:00100000:0.0:1775764786.891143:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+64:2411:x1862023076076928:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764786.891159:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764786.891166:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 64 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.891179:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 64 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.891201:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:0.0:1775764786.891206:0:25199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.891216:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.891238:0:25199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.891257:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764786.891318:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+64:2411:x1862023076076928:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 175us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.891326:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1389 00010000:00010000:3.0:1775764786.893026:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523462 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5222 expref: 63 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.893152:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099792640:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764786.893194:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893296:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893303:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764786.893323:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9c:0x0]: returning size 0 00000004:00080000:2.0:1775764786.893569:0:6522:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x54:0x0], index 0: 0 00010000:00010000:2.0:1775764786.893675:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893685:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893692:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893699:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.893702:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893710:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.893735:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:2.0:1775764786.893738:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764786.893755:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.894036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523470 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.894182:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523469 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5229 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.894195:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:2.0:1775764786.894197:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764786.894201:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523469 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5229 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.894209:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9600, rc 0) 00000100:00100000:2.0:1775764786.894306:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+62:46281:x1862023076076800:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 8344us (8592us total) trans 4294970612 rc 301/301 00000100:00100000:2.0:1775764786.894315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6434 00000100:00100000:0.0:1775764786.897665:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.898241:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076077184 00000100:00100000:3.0:1775764786.898252:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076077184 00000100:00100000:0.0:1775764786.898403:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1347 00000100:00100000:0.0:1775764786.898414:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+62:46281:x1862023076077184:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1775764786.898746:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+63:46281:x1862023076077184:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 326us (1086us total) trans 4294970613 rc 0/0 00000100:00100000:0.0:1775764786.898755:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1347 00000100:00100000:3.0:1775764786.901518:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.901606:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076077312 00000100:00100000:1.0:1775764786.901616:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076077312 00000100:00100000:1.0:1775764786.901675:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6435 00000100:00100000:1.0:1775764786.901686:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+63:46281:x1862023076077312:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764786.901710:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764786.901731:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52347e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5230 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.901863:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523485 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.901879:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.901890:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764786.901934:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9c:0x0]: returning size 0 00000004:00200000:1.0:1775764786.901938:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764786.901958:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523485 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.901987:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed52347e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5230 expref: 65 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.902003:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523485 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5230 expref: 64 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.902023:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:1.0:1775764786.902026:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1775764786.902029:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5a00, rc 0) 00000100:00100000:1.0:1775764786.902094:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+64:46281:x1862023076077312:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 410us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.902101:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6435 00000100:00100000:1.0:1775764786.905089:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.905215:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076077440 00000100:00100000:2.0:1775764786.905225:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076077440 00000100:00100000:2.0:1775764786.905270:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1697 00000100:00100000:2.0:1775764786.905279:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2409:x1862023076077440:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764786.905295:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764786.905313:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5237 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764786.905355:0:8402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1775764786.905375:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764786.905377:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764786.905386:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.905403:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.905416:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0600, rc 0) 00000100:00100000:2.0:1775764786.905487:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076077440:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 210us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.905494:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1697 00000100:00100000:1.0:1775764786.908969:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.909197:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076077696 00000100:00100000:3.0:1775764786.909208:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076077696 00000100:00100000:3.0:1775764786.909267:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6436 00000100:00100000:3.0:1775764786.909276:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+64:46281:x1862023076077696:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764786.909429:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+64:46281:x1862023076077696:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 154us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.909437:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6436 00000100:00100000:1.0:1775764786.914875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.915015:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076077824 00000100:00100000:0.0:1775764786.915024:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076077824 00000100:00100000:0.0:1775764786.915101:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1698 00000100:00100000:0.0:1775764786.915110:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:46281:x1862023076077824:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764786.915127:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764786.915144:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd523e expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.915174:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.915182:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764786.915195:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764786.915200:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.915232:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.915246:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 9 pid: 8402 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.915261:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099792768:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764786.915347:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1775764786.918523:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.918607:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076077952 00000100:00100000:3.0:1775764786.918617:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076077952 00010000:00010000:3.0:1775764786.918655:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 10 pid: 8402 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.918696:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1390 00000100:00100000:3.0:1775764786.918705:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076077952:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764786.918721:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764786.918751:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 10 pid: 8402 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.918764:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 10 pid: 8402 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.918846:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.918849:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764786.918857:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 10 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.918867:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 10 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.918909:0:25200:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 10 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.918923:0:25200:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25200:1862023099792896:192.168.202.58@tcp:105: 00000100:00100000:3.0:1775764786.918994:0:25200:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20240 going to sleep for 11 seconds 00010000:00010000:0.0:1775764786.919943:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c3ed71/0x6e98bd47ed52348c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5237 expref: 10 pid: 8402 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.919959:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099792768:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764786.919981:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.919993:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d000, rc 0) 00000100:00100000:0.0:1775764786.920032:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+9:46281:x1862023076077824:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 4922us (5165us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.920114:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1698 00000100:00100000:1.0:1775764786.924584:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.924664:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076078080 00000100:00100000:2.0:1775764786.924673:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076078080 00002000:00100000:2.0:1775764786.924723:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x54:0x0] (0->157) req@ffff96c1c2c27800 x1862023076078080/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:267/0 lens 648/0 e 0 to 0 dl 1775764797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764786.924734:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2c27800 with x1862023076078080 ext(0->157) 00002000:00010000:2.0:1775764786.924748:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c2c27800 00000100:00100000:2.0:1775764786.924811:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 428 00000100:00100000:2.0:1775764786.924819:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076078080:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1775764786.926094:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+11:2411:x1862023076078080:12345-192.168.202.58@tcp:4:lhsmtool_posix.0 Request processed in 1268us (1512us total) trans 4294967720 rc 0/0 00000100:00100000:2.0:1775764786.926106:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 428 00002000:00100000:2.0:1775764786.926126:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x54:0x0] (0->157) req@ffff96c1c2c27800 x1862023076078080/t4294967720(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:267/0 lens 648/448 e 0 to 0 dl 1775764797 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764786.926135:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2c27800 with x1862023076078080 ext(0->157) 00002000:00010000:2.0:1775764786.926140:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c2c27800 00000100:00100000:3.0:1775764786.926361:0:25200:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25200:1862023099792896:192.168.202.58@tcp:105: 00010000:00010000:3.0:1775764786.926385:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764786.926408:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076077952:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 7705us (7899us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.926416:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1390 00000100:00100000:1.0:1775764786.929810:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.929954:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076078208 00000100:00100000:0.0:1775764786.929966:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076078208 00000100:00100000:0.0:1775764786.930027:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6437 00000100:00100000:0.0:1775764786.930061:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+64:46281:x1862023076078208:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1775764786.932649:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970613 is committed 00000001:00080000:3.0:1775764786.932722:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970607 is committed 00000004:00080000:3.0:1775764786.932733:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00000020:00080000:3.0:1775764786.932757:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c1c5c0a780 refcount 2 committed 0 result 0 batchid 122 00000020:00080000:3.0:1775764786.932763:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2db5300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c5c0a9c0 00000020:00080000:3.0:1775764786.932766:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2db5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2c8ae00 00000020:00080000:3.0:1775764786.932863:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 121 batchid updated 00010000:00010000:2.0:1775764786.932937:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.932948:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.932956:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.932963:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.932967:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.932975:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.932992:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f500) 00010000:00010000:2.0:1775764786.932995:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764786.933002:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933008:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5232b0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933046:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933063:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933068:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933073:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764786.933076:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933082:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933090:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:2.0:1775764786.933093:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1775764786.933096:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933102:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed52345b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1775764786.933230:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 122 committed batchid 121 00000020:00080000:2.0:1775764786.933288:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 121 00000100:00100000:2.0:1775764786.933299:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764786.933317:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099793024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1775764786.933391:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764786.933436:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099793024 00000100:00100000:2.0:1775764786.933443:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099793024 00000100:00100000:2.0:1775764786.933485:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:2.0:1775764786.933493:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099793024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1775764786.933526:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:83 count 1 00002000:00010000:2.0:1775764786.933558:0:8403:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x53:0x0] initial LVB size: 158, mtime: 0x69d80530, atime: 0x0, ctime: 0x69d80530, blocks: 0x8 00010000:00010000:2.0:1775764786.933565:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933580:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764786.933582:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764786.933588:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933600:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933608:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933616:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.933632:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1775764786.933754:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3662:x1862023099793024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 248us (350us total) trans 4294967721 rc 0/0 00000100:00100000:2.0:1775764786.933762:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000004:00080000:2.0:1775764786.933876:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c1c73f9880/2, rc 0, transno 4294967721 00000100:00100000:2.0:1775764786.933883:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099793024:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1775764786.934054:0:6509:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775764786.934060:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.934069:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764786.934074:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.934082:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.934097:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.934105:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9fea8d/0x6e98bd47ed52349a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.934121:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764786.934123:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764786.934125:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764786.934260:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:46281:x1862023076078208:12345-192.168.202.58@tcp:44:lhsmtool_posix.0 Request processed in 4200us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764786.934270:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6437 00010000:00010000:0.0:1775764786.935438:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935477:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935484:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935490:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764786.935494:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935500:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935517:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x342303f9 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764786.935520:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764786.935523:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935528:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523198 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x342303f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935550:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935557:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935563:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935567:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764786.935576:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935582:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935595:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764786.935598:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764786.935601:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935606:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52319f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935622:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935627:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935632:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935636:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764786.935639:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935645:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935651:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x43454b14 (ffff96c2c7e0f800) 00010000:00010000:0.0:1775764786.935654:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764786.935663:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935668:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5231e5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935680:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935686:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935691:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935695:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764786.935698:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935702:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935709:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff96c2c7e0f300) 00010000:00010000:0.0:1775764786.935711:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764786.935713:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935717:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed5231ec lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935730:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935736:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935757:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935762:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764786.935764:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935794:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935803:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0xc9365186 (ffff96c2c7e0fc00) 00010000:00010000:0.0:1775764786.935805:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764786.935809:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.935815:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523382 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0xc9365186 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.937719:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.938122:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076078336 00000100:00100000:2.0:1775764786.938135:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076078336 00000100:00100000:2.0:1775764786.938218:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1700 00000100:00100000:2.0:1775764786.938228:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076078336:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1775764786.939726:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967721 is committed 00000001:00080000:0.0:1775764786.939738:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967720 is committed 00000100:00100000:2.0:1775764786.940187:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076078336:12345-192.168.202.58@tcp:16:lhsmtool_posix.0 Request processed in 1955us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.940198:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1700 00000100:00100000:2.0:1775764786.943257:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.943349:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076078592 00000100:00100000:3.0:1775764786.943359:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076078592 00000100:00100000:3.0:1775764786.943474:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6438 00000100:00100000:3.0:1775764786.943483:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:46281:x1862023076078592:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1775764786.943543:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764786.943575:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523485 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5230 expref: 49 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.943598:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764786.943603:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764786.943639:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.943655:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.943665:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764786.943877:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a6b9087a reply state 000000001b6e315d transno 4294970614 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.943889:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.943895:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764786.943898:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764786.943914:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1775764786.944014:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:46281:x1862023076078592:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 531us (769us total) trans 4294970614 rc 0/0 00000100:00100000:3.0:1775764786.944021:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6438 00000100:00100000:1.0:1775764786.947176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.947247:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076078720 00000100:00100000:3.0:1775764786.947257:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076078720 00000100:00100000:3.0:1775764786.947353:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6439 00000100:00100000:3.0:1775764786.947363:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:46281:x1862023076078720:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764786.947389:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764786.947409:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5245 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.947475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.947492:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.947512:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764786.947516:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1775764786.947519:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764786.947621:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:46281:x1862023076078720:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 259us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.947628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6439 00000100:00100000:0.0:1775764786.950231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.950317:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076078848 00000100:00100000:2.0:1775764786.950327:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076078848 00000100:00100000:2.0:1775764786.950415:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1701 00000100:00100000:2.0:1775764786.950427:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076078848:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1775764786.950668:0:8405:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1775764786.950672:0:8405:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb mtime from disk: 0 -> 1775764784 00002000:00010000:2.0:1775764786.950674:0:8405:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb atime from disk: 0 -> 1775764785 00002000:00010000:2.0:1775764786.950676:0:8405:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb ctime from disk: 0 -> 1775764784 00002000:00010000:2.0:1775764786.950678:0:8405:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x54:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1775764786.950737:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076078848:12345-192.168.202.58@tcp:2:lhsmtool_posix.0 Request processed in 313us (514us total) trans 4294967722 rc 0/0 00000100:00100000:2.0:1775764786.950753:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1701 00000100:00100000:3.0:1775764786.952847:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.952940:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076079104 00000100:00100000:0.0:1775764786.952949:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076079104 00000100:00100000:0.0:1775764786.953004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6440 00000100:00100000:0.0:1775764786.953013:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:46281:x1862023076079104:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1775764786.953089:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.953105:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 51 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.953128:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.953162:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 51 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764786.953176:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 51 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.953190:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099793152:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764786.953258:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1775764786.956177:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764786.956277:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099793152:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764786.956305:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.956374:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076079232 00000100:00100000:3.0:1775764786.956381:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076079232 00010000:00010000:3.0:1775764786.956415:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 52 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.956476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1391 00000100:00100000:3.0:1775764786.956486:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+52:2411:x1862023076079232:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764786.956501:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764786.956507:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 52 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.956519:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 52 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.956540:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523454 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd521b expref: 52 pid: 10681 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.956553:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764786.956558:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.956567:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.956574:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.956603:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764786.956654:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076079232:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 170us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.956661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1391 00010000:00010000:1.0:1775764786.956885:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956892:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956929:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956936:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956943:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956959:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.956963:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956970:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:1.0:1775764786.956982:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1775764786.956985:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.956990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5234af lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764786.957044:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:46281:x1862023076079104:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 Request processed in 4031us (4204us total) trans 0 rc -22/-22 00000100:00100000:1.0:1775764786.957052:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6440 00000100:00100000:1.0:1775764786.960567:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.962190:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076079360 00000100:00100000:3.0:1775764786.962221:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076079360 00000100:00100000:3.0:1775764786.962414:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1702 00000100:00100000:3.0:1775764786.962425:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076079360:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764786.962473:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.962491:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 7 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.962498:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764786.962500:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764786.962504:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.962539:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 7 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.962554:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 7 pid: 24969 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.962570:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099793280:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764786.962673:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20d80 going to sleep for 11 seconds 00000100:00100000:0.0:1775764786.967396:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764786.967552:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076079488 00000100:00100000:1.0:1775764786.967564:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076079488 00010000:00010000:1.0:1775764786.967605:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 8 pid: 24969 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764786.967651:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1392 00000100:00100000:1.0:1775764786.967661:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076079488:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764786.967678:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764786.967701:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 8 pid: 24969 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.967748:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 8 pid: 24969 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.967805:0:8419:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764786.967808:0:8419:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764786.967814:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.967825:0:8419:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.967850:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764786.967904:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076079488:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 244us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.967913:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1392 00010000:00010000:2.0:1775764786.968628:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072888b41/0x6e98bd47ed523493 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd523e expref: 7 pid: 24969 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.968646:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099793280:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764786.968666:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968693:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968700:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968737:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968754:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968798:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968805:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764786.968810:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968819:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968835:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.968853:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004258d78d/0x6e98bd47ed5234b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.968922:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076079360:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 6499us (8365us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.968931:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1702 00000100:00100000:0.0:1775764786.972989:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.973073:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076079744 00000100:00100000:2.0:1775764786.973084:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076079744 00000100:00100000:2.0:1775764786.973140:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6441 00000100:00100000:2.0:1775764786.973150:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+50:46281:x1862023076079744:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1775764786.973231:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.973250:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 26 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.973260:0:10681:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.973301:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 26 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.973316:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 26 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.973330:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099793408:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764786.973432:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d88389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764786.977348:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099793408:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764786.977379:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764786.979352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764786.980288:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076079872 00000100:00100000:2.0:1775764786.980311:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076079872 00010000:00010000:2.0:1775764786.980359:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 27 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.980397:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1393 00000100:00100000:2.0:1775764786.980406:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+27:2411:x1862023076079872:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764786.980422:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764786.980430:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 27 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980443:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 27 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980599:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5233eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51ff expref: 27 pid: 14288 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980619:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764786.980625:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980634:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980657:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980664:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.980700:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764786.980879:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.980888:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.981086:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.981098:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.981106:0:10681:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.981138:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.981153:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 51 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.981169:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099793536:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764786.981514:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:2411:x1862023076079872:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 1108us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.981524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1393 00000100:00100000:2.0:1775764786.983697:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20d80 going to sleep for 11 seconds 00000100:00100000:1.0:1775764786.987542:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099793536:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764786.987580:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764786.988046:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764786.988378:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076080000 00000100:00100000:3.0:1775764786.988388:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076080000 00010000:00010000:3.0:1775764786.988427:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 52 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764786.988473:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1394 00000100:00100000:3.0:1775764786.988482:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+52:2410:x1862023076080000:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764786.988498:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764786.988505:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 52 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.988536:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 52 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.988559:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed5234a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5245 expref: 52 pid: 6523 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.988576:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764786.988581:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.988589:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.988596:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764786.988625:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764786.988675:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+51:2410:x1862023076080000:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 194us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764786.988683:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1394 00010000:00010000:2.0:1775764786.989524:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764786.989536:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1775764786.989651:0:10681:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970615 00000001:00080000:2.0:1775764786.989889:0:10681:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970616 00000001:00080000:2.0:1775764786.989926:0:10681:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970617 00000100:00100000:2.0:1775764786.990016:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1862023099793664:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1775764786.990537:0:10681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764786.990610:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d1b7d600 going to sleep for 11 seconds 00000100:00100000:3.0:1775764786.992607:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099793664 00000100:00100000:3.0:1775764786.992622:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099793664 00000100:00100000:2.0:1775764786.993018:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1775764786.993031:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10681:x1862023099793664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1775764786.993172:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10681:x1862023099793664:12345-0@lo:1000:mdt00_004.0 Request processed in 145us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764786.993199:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1775764786.993286:0:10681:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967721 gen 2 00000004:00080000:1.0:1775764786.993294:0:10681:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967719 committed transno 4294967721 00000004:00080000:1.0:1775764786.993324:0:10681:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c1c73f9880, transno 4294967721 00000100:00100000:1.0:1775764786.993344:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff970380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1862023099793664:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1775764786.993501:0:10681:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970618 00000100:00100000:1.0:1775764786.993574:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1862023099793792:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1775764786.993619:0:10681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764786.994482:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764786.994498:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099793920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764786.994537:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764786.995105:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099793920 00000100:00100000:1.0:1775764786.995113:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099793920 00000100:00100000:1.0:1775764786.995154:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1775764786.995162:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099793920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764786.995186:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41332928 pending 0 free 3916959744 avail 3685380096 00000100:00100000:1.0:1775764786.995235:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099793920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.995243:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1775764786.995442:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099794048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764786.995480:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764786.995509:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099794048 00000100:00100000:1.0:1775764786.995513:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099794048 00000100:00100000:1.0:1775764786.995543:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1775764786.995549:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099794048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764786.995559:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41332928 pending 0 free 3916959744 avail 3685380096 00000100:00100000:1.0:1775764786.995586:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099794048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764786.995592:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00080000:1.0:1775764786.995606:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764786.995637:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099794048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764786.995668:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099793920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764786.995683:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d88386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764786.996631:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099793792 00000100:00100000:0.0:1775764786.996640:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099793792 00000100:00100000:0.0:1775764786.996682:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1775764786.996691:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10681:x1862023099793792:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1775764786.996888:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10681:x1862023099793792:12345-0@lo:1000:mdt00_004.0 Request processed in 198us (3269us total) trans 4294967723 rc 0/0 00000100:00100000:0.0:1775764786.996895:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1775764786.997426:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10681:1862023099793792:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1775764786.997576:0:10681:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970619 00010000:00010000:1.0:1775764786.997627:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997638:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997646:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997652:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.997658:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997665:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997682:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:1.0:1775764786.997685:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1775764786.997689:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997695:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5234c4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997717:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997722:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997889:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997896:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764786.997904:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997910:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997919:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:1.0:1775764786.997921:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1775764786.997927:0:10681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997938:0:10681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997947:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764786.997977:0:10681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764786.997989:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2c25500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099794176:192.168.202.58@tcp:105: 00000100:00100000:1.0:1775764786.998165:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c635d780 going to sleep for 11 seconds 00000100:00100000:3.0:1775764787.002485:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.002644:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076080128 00000100:00100000:0.0:1775764787.002669:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076080128 00000100:00100000:0.0:1775764787.002753:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1348 00000100:00100000:0.0:1775764787.002763:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:46280:x1862023076080128:12345-192.168.202.58@tcp:49:tar.0 00000100:00100000:0.0:1775764787.002921:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:46280:x1862023076080128:12345-192.168.202.58@tcp:49:tar.0 Request processed in 159us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764787.002930:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1348 00000100:00080000:2.0:1775764787.003234:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764787.003340:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2c25500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099794176:192.168.202.58@tcp:105: 00010000:00010000:1.0:1775764787.003381:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003392:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5233f2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003436:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003450:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003462:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003471:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003477:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003484:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003489:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764787.003494:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003501:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003511:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:1.0:1775764787.003514:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764787.003517:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003523:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5234cb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003547:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003553:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003559:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003563:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764787.003566:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003571:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003579:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:1.0:1775764787.003581:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1775764787.003583:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.003589:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5234bd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764787.003728:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:46281:x1862023076079744:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 30579us (30752us total) trans 4294970620 rc 0/0 00000100:00100000:1.0:1775764787.003737:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6441 00000020:00080000:1.0:1775764787.003752:0:10681:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1775764787.003895:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764787.003900:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764787.004379:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1775764787.004387:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764787.009262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.009460:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076080384 00000100:00100000:0.0:1775764787.009472:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076080384 00000100:00100000:0.0:1775764787.009557:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1349 00000100:00100000:0.0:1775764787.009570:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:46281:x1862023076080384:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00080000:2.0:1775764787.009897:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1775764787.010219:0:24972:0:(mdd_object.c:4010:mdd_close()) Object [0x200000403:0x9c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1775764787.010257:0:24972:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970621 00010000:00010000:0.0:1775764787.010291:0:24972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.010320:0:24972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.010336:0:24972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.010345:0:24972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.010351:0:24972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.010356:0:24972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.010394:0:24972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1775764787.010500:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:46281:x1862023076080384:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 932us (1248us total) trans 4294970622 rc 0/0 00000100:00100000:0.0:1775764787.010509:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1349 00000020:00080000:0.0:1775764787.010514:0:24972:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1775764787.010897:0:6508:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764787.010910:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.010916:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6cc00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764787.010920:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.010928:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.010941:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764787.010944:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1775764787.010949:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.010954:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5234d2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 24972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.010966:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764787.010968:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764787.010969:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764787.015596:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.015673:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076080512 00000100:00100000:3.0:1775764787.015684:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076080512 00000100:00100000:3.0:1775764787.015801:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1703 00000100:00100000:3.0:1775764787.015812:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:46280:x1862023076080512:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764787.015831:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764787.015853:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd524c expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764787.015880:0:8641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x54:0x0] initial LVB size: 158, mtime: 0x69d80530, atime: 0x69d80531, ctime: 0x69d80530, blocks: 0x8 00010000:00010000:3.0:1775764787.015903:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764787.015919:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764787.015928:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.015944:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 7 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.015957:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764787.016012:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:46280:x1862023076080512:12345-192.168.202.58@tcp:101:tar.0 Request processed in 202us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764787.016019:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1703 00000100:00080000:2.0:1775764787.016200:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764787.020010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.020173:0:8410:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076080640 00000100:00100000:2.0:1775764787.020184:0:8410:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076080640 00002000:00100000:2.0:1775764787.020233:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x54:0x0] (0->4095) req@ffff96c1c2c25500 x1862023076080640/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:268/0 lens 488/0 e 0 to 0 dl 1775764798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764787.020244:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2c25500 with x1862023076080640 ext(0->4095) 00002000:00010000:2.0:1775764787.020250:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c2c25500 00000100:00100000:2.0:1775764787.020285:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 429 00000100:00100000:2.0:1775764787.020295:0:8410:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076080640:12345-192.168.202.58@tcp:3:tar.0 00000100:00100000:2.0:1775764787.020515:0:8410:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076080640:12345-192.168.202.58@tcp:3:tar.0 Request processed in 220us (513us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1775764787.020523:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 429 00002000:00100000:2.0:1775764787.020530:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x54:0x0] (0->4095) req@ffff96c1c2c25500 x1862023076080640/t0(0) o3->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:268/0 lens 488/4536 e 0 to 0 dl 1775764798 ref 1 fl Complete:/600/0 rc 4096/4096 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764787.020537:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2c25500 with x1862023076080640 ext(0->4095) 00002000:00010000:2.0:1775764787.020540:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c2c25500 00000100:00100000:0.0:1775764787.028863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.028957:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076080768 00000100:00100000:3.0:1775764787.028968:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076080768 00000100:00100000:3.0:1775764787.029027:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6442 00000100:00100000:3.0:1775764787.029042:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+26:46280:x1862023076080768:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764787.029064:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764787.029086:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed5234e0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5253 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.029177:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5234e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.029192:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5234e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.029203:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5234e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764787.029231:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00000004:00200000:3.0:1775764787.029249:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764787.029270:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5234e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.029296:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed5234e0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5253 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.029316:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5234e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5253 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.029326:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:3.0:1775764787.029330:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764787.029334:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764787.029388:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+27:46280:x1862023076080768:12345-192.168.202.58@tcp:101:tar.0 Request processed in 352us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764787.029394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6442 00000100:00100000:1.0:1775764787.032866:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.032974:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076081024 00000100:00100000:3.0:1775764787.032986:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076081024 00000100:00100000:3.0:1775764787.033045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1350 00000100:00100000:3.0:1775764787.033055:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+27:46280:x1862023076081024:12345-192.168.202.58@tcp:35:tar.0 00000100:00100000:3.0:1775764787.033274:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:46280:x1862023076081024:12345-192.168.202.58@tcp:35:tar.0 Request processed in 220us (419us total) trans 4294970623 rc 0/0 00000100:00100000:3.0:1775764787.033283:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1350 00000100:00100000:1.0:1775764787.036211:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.036310:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076081152 00000100:00100000:0.0:1775764787.036321:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076081152 00000100:00100000:0.0:1775764787.036376:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1704 00000100:00100000:0.0:1775764787.036387:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:46280:x1862023076081152:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:0.0:1775764787.036404:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764787.036422:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a26fee04/0x6e98bd47ed5234ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd525a expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.036452:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.036474:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764787.036477:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764787.036481:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a26fee04/0x6e98bd47ed5234ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd525a expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.036517:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.036548:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 9 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764787.036564:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099794304:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764787.036642:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0a900 going to sleep for 11 seconds 00000100:00100000:3.0:1775764787.039897:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099794304:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764787.039931:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a26fee04/0x6e98bd47ed5234ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd525a expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.039971:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d600, rc 0) 00000100:00100000:1.0:1775764787.041380:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.041569:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076081280 00000100:00100000:0.0:1775764787.041579:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076081280 00010000:00010000:0.0:1775764787.041621:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 10 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764787.041663:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1395 00000100:00100000:0.0:1775764787.041673:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c66a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076081280:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764787.041688:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764787.041708:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 10 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.041722:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 10 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.041765:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045c6c734/0x6e98bd47ed523397 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd51dc expref: 10 pid: 8403 timeout: 1394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.041807:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764787.041824:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764787.041832:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a26fee04/0x6e98bd47ed5234ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd525a expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.041843:0:6507:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a26fee04/0x6e98bd47ed5234ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd525a expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.041878:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a26fee04/0x6e98bd47ed5234ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd525a expref: 9 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764787.041893:0:6507:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1862023099794432:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764787.041978:0:6507:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0a540 going to sleep for 11 seconds 00000100:00100000:2.0:1775764787.043544:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:46280:x1862023076081152:12345-192.168.202.58@tcp:101:tar.0 Request processed in 7149us (7331us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764787.043570:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1704 00000100:00100000:1.0:1775764787.048591:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.049285:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076081536 00000100:00100000:2.0:1775764787.049296:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076081536 00000100:00100000:2.0:1775764787.049361:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1351 00000100:00100000:2.0:1775764787.049372:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df701c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+28:46280:x1862023076081536:12345-192.168.202.58@tcp:35:tar.0 00000100:00100000:2.0:1775764787.049705:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df701c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+29:46280:x1862023076081536:12345-192.168.202.58@tcp:35:tar.0 Request processed in 334us (1123us total) trans 4294970624 rc 0/0 00000100:00100000:2.0:1775764787.049713:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1351 00000100:00100000:0.0:1775764787.052369:0:6507:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1862023099794432:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764787.052401:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764787.052628:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c66a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076081280:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 10954us (11253us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764787.052641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1395 00010000:00010000:2.0:1775764787.058208:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764787.058379:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764787.058385:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764787.059313:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764787.059326:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764787.062091:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.062559:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076081792 00000100:00100000:0.0:1775764787.062569:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076081792 00000100:00100000:0.0:1775764787.062633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1352 00000100:00100000:0.0:1775764787.062644:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+29:46280:x1862023076081792:12345-192.168.202.58@tcp:35:tar.0 00000100:00100000:0.0:1775764787.062942:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46280:x1862023076081792:12345-192.168.202.58@tcp:35:tar.0 Request processed in 300us (862us total) trans 4294970625 rc 0/0 00000100:00100000:0.0:1775764787.062951:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1352 00000100:00100000:0.0:1775764787.079085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.079218:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076081920 00000100:00100000:3.0:1775764787.079228:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076081920 00000100:00100000:3.0:1775764787.079293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6443 00000100:00100000:3.0:1775764787.079302:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46282:x1862023076081920:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764787.079327:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764787.079347:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed5234f5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5261 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079413:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079428:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079441:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079467:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079482:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079546:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079568:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079575:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764787.079609:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9b:0x0]: returning size 158 00000004:00200000:3.0:1775764787.079613:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764787.079629:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079639:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079648:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079653:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079659:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079665:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079671:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764787.079675:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079683:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079705:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:3.0:1775764787.079708:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764787.079713:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079719:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5234fc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079732:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079746:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079752:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079758:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764787.079760:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079766:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079821:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c1c2a03d00) 00010000:00010000:3.0:1775764787.079823:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764787.079826:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079831:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523503 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079875:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed5234f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5261 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079888:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5261 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.079896:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:3.0:1775764787.079898:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764787.079900:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8400, rc 0) 00000100:00100000:3.0:1775764787.079964:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:46282:x1862023076081920:12345-192.168.202.58@tcp:101:rm.0 Request processed in 664us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764787.079971:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6443 00000100:00100000:3.0:1775764787.084500:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764787.085053:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076082176 00000100:00100000:1.0:1775764787.085064:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076082176 00000100:00100000:1.0:1775764787.085126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6444 00000100:00100000:1.0:1775764787.085136:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:46282:x1862023076082176:12345-192.168.202.58@tcp:36:rm.0 00010000:00010000:1.0:1775764787.085191:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1775764787.085222:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed52350a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5261 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085243:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5234e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5253 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085253:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5233f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5206 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085263:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c1c4135f00) 00010000:00010000:1.0:1775764787.085275:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764787.085296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085310:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085318:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085347:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085354:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085361:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085435:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085444:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085450:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1775764787.085667:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].68, 64 off13384 00010000:00010000:1.0:1775764787.085719:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085745:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085753:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085803:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085812:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085824:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085841:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1775764787.085861:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085866:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085871:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085876:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764787.085881:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085888:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085898:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0fd00) 00010000:00010000:1.0:1775764787.085901:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1775764787.085904:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52351f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085925:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085930:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085943:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085948:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085952:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764787.085955:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085960:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085967:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:1.0:1775764787.085969:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764787.085972:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 3/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085977:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523511 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764787.085985:0:6521:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000072ce05e9 reply state 00000000fc9681eb transno 4294970626 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.085995:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.086001:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764787.086003:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764787.086006:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764787.086090:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46282:x1862023076082176:12345-192.168.202.58@tcp:36:rm.0 Request processed in 953us (1599us total) trans 4294970626 rc 0/0 00000100:00100000:1.0:1775764787.086102:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6444 00010000:00010000:3.0:1775764787.086804:0:9477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764787.086811:0:9477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.086819:0:9477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764787.086822:0:9477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.086830:0:9477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.086841:0:9477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9b:0x0].0x0 (ffff96c2c7e0fd00) 00010000:00010000:3.0:1775764787.086843:0:9477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1775764787.086846:0:9477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.086863:0:9477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4200/0x6e98bd47ed523526 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.086879:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764787.086881:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764787.086882:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764787.105306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.105469:0:25201:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076082304 00000100:00100000:3.0:1775764787.105480:0:25201:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076082304 00002000:00100000:3.0:1775764787.105530:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x54:0x0] (0->10239) req@ffff96c1c3773b80 x1862023076082304/t0(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:268/0 lens 10728/0 e 0 to 0 dl 1775764798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764787.105542:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c3773b80 with x1862023076082304 ext(0->10239) 00002000:00010000:3.0:1775764787.105548:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c3773b80 00000100:00100000:3.0:1775764787.105581:0:25201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 430 00000100:00100000:3.0:1775764787.105591:0:25201:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076082304:12345-192.168.202.58@tcp:4:tar.0 00000100:00100000:3.0:1775764787.107679:0:25201:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076082304:12345-192.168.202.58@tcp:4:tar.0 Request processed in 2079us (2370us total) trans 4294967720 rc 0/0 00000100:00100000:3.0:1775764787.107691:0:25201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 430 00002000:00100000:3.0:1775764787.107705:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x54:0x0] (0->10239) req@ffff96c1c3773b80 x1862023076082304/t4294967720(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:268/0 lens 10728/448 e 0 to 0 dl 1775764798 ref 1 fl Complete:/600/0 rc 0/0 job:'tar.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764787.107716:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c3773b80 with x1862023076082304 ext(0->10239) 00002000:00010000:3.0:1775764787.107722:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c3773b80 00000100:00100000:2.0:1775764787.126062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764787.126140:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076082560 00000100:00100000:1.0:1775764787.126151:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076082560 00000100:00100000:1.0:1775764787.126207:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6445 00000100:00100000:1.0:1775764787.126218:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46284:x1862023076082560:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:1.0:1775764787.126244:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764787.126265:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52352d lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5268 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.126372:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523534 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.126386:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523534 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.126397:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523534 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764787.126410:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 10240 00010000:00010000:1.0:1775764787.126524:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52352d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5268 expref: 33 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.126549:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4400/0x6e98bd47ed523534 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5268 expref: 32 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.126559:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff96c2c7e0f100) 00010000:00010000:1.0:1775764787.126561:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1775764787.126580:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4400, rc 0) 00000100:00100000:1.0:1775764787.126654:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46284:x1862023076082560:12345-192.168.202.58@tcp:101:tar.0 Request processed in 437us (601us total) trans 4294970627 rc 0/0 00000100:00100000:1.0:1775764787.126661:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6445 00000100:00100000:1.0:1775764787.135915:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.136026:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076082816 00000100:00100000:0.0:1775764787.136056:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076082816 00000100:00100000:0.0:1775764787.136120:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6446 00000100:00100000:0.0:1775764787.136129:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46284:x1862023076082816:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:0.0:1775764787.136155:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764787.136178:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd526f expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.136287:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed523549 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.136301:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed523549 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.136315:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed523549 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764787.136326:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1775764787.136426:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd526f expref: 35 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.136444:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ca00/0x6e98bd47ed523549 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd526f expref: 34 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.136454:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764787.136457:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1775764787.136461:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ca00, rc 0) 00000100:00100000:0.0:1775764787.136526:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46284:x1862023076082816:12345-192.168.202.58@tcp:101:tar.0 Request processed in 398us (623us total) trans 4294970628 rc 0/0 00000100:00100000:0.0:1775764787.136533:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6446 00000100:00100000:2.0:1775764787.140256:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.140479:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076083072 00000100:00100000:3.0:1775764787.140493:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076083072 00000100:00100000:3.0:1775764787.140559:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6447 00000100:00100000:3.0:1775764787.140568:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46284:x1862023076083072:12345-192.168.202.58@tcp:36:tar.0 00010000:00010000:3.0:1775764787.140711:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.140748:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.140767:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.140810:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,1 mode: --/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.140817:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.140823:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141166:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141175:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141180:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141186:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141192:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764787.141196:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141210:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141224:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:3.0:1775764787.141227:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764787.141233:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 3/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141239:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523557 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764787.141253:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d9f35296 reply state 00000000eaa5c5a4 transno 4294970629 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141265:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.141270:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:3.0:1775764787.141272:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764787.141275:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1775764787.141376:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46284:x1862023076083072:12345-192.168.202.58@tcp:36:tar.0 Request processed in 807us (1129us total) trans 4294970629 rc 0/0 00000100:00100000:3.0:1775764787.141384:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6447 00000100:00100000:2.0:1775764787.145136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.145244:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076083200 00000100:00100000:0.0:1775764787.145256:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076083200 00000100:00100000:0.0:1775764787.145326:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6448 00000100:00100000:0.0:1775764787.145337:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46284:x1862023076083200:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:0.0:1775764787.145368:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764787.145395:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523565 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5276 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145481:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145498:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145510:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145521:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145529:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145535:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145620:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145627:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145652:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764787.145694:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00200000:0.0:1775764787.145698:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764787.145719:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145730:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145749:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145755:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145761:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145767:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764787.145811:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145820:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145831:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:0.0:1775764787.145835:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764787.145839:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145856:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52356c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145869:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145874:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145879:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145883:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764787.145886:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145892:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145900:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:0.0:1775764787.145902:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764787.145905:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145909:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523573 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145934:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523565 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 38 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145959:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 37 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.145966:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:0.0:1775764787.145968:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764787.145970:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c000, rc 0) 00000100:00100000:0.0:1775764787.146031:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:46284:x1862023076083200:12345-192.168.202.58@tcp:101:tar.0 Request processed in 696us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764787.146038:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6448 00000100:00100000:0.0:1775764787.150762:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.150898:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076083456 00000100:00100000:3.0:1775764787.150909:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076083456 00000100:00100000:3.0:1775764787.150965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6449 00000100:00100000:3.0:1775764787.150975:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:46284:x1862023076083456:12345-192.168.202.58@tcp:36:tar.0 00010000:00010000:3.0:1775764787.151067:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.151102:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 37 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.151112:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.151147:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 37 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.151159:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 37 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764787.151174:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099794560:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764787.151257:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20240 going to sleep for 11 seconds 00000100:00100000:2.0:1775764787.155146:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.155235:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076083584 00000100:00100000:0.0:1775764787.155246:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076083584 00010000:00010000:0.0:1775764787.155286:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 38 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764787.155324:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1396 00000100:00100000:0.0:1775764787.155332:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:2410:x1862023076083584:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764787.155346:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764787.155352:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 38 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.155366:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 38 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.155391:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:0.0:1775764787.155411:0:25199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.155421:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.155429:0:25199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.155450:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764787.155507:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:2410:x1862023076083584:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 175us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764787.155514:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1396 00010000:00010000:3.0:1775764787.155674:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed52357a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5276 expref: 37 pid: 10088 timeout: 1394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764787.155691:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099794560:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764787.155711:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.155720:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.155735:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764787.155953:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000241c9c24 reply state 0000000071b8cb8f transno 4294970630 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.155977:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.155983:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:3.0:1775764787.155985:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1775764787.155988:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1775764787.156031:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:46284:x1862023076083456:12345-192.168.202.58@tcp:36:tar.0 Request processed in 5057us (5282us total) trans 4294970630 rc 0/0 00000100:00100000:3.0:1775764787.156051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6449 00000100:00100000:2.0:1775764787.159905:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.160199:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076083840 00000100:00100000:3.0:1775764787.160210:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076083840 00000100:00100000:3.0:1775764787.160269:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6450 00000100:00100000:3.0:1775764787.160280:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:46284:x1862023076083840:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:3.0:1775764787.160305:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764787.160332:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523588 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd527d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160475:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160493:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160507:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160516:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160542:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160549:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160615:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160623:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160630:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764787.160640:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00080000:3.0:1775764787.160828:0:6523:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x55:0x0], index 1: 0 00010000:00010000:3.0:1775764787.160925:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160932:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160939:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160945:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764787.160949:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160956:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160975:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:3.0:1775764787.160978:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1775764787.160983:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.160989:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed52359d lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161003:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161009:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161014:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161019:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161024:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764787.161026:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161032:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161038:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:3.0:1775764787.161040:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764787.161043:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161056:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52358f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161064:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161070:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161075:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161079:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764787.161081:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161086:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161091:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:3.0:1775764787.161093:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764787.161095:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161100:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523596 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161138:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523588 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd527d expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161157:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:3.0:1775764787.161160:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764787.161163:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523588 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd527d expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.161172:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764787.161247:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:46284:x1862023076083840:12345-192.168.202.58@tcp:101:tar.0 Request processed in 969us (1354us total) trans 4294970631 rc 301/301 00000100:00100000:3.0:1775764787.161255:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6450 00000100:00100000:1.0:1775764787.165907:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.166089:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076083968 00000100:00100000:0.0:1775764787.166099:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076083968 00000100:00100000:0.0:1775764787.166153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6451 00000100:00100000:0.0:1775764787.166163:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:46284:x1862023076083968:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:0.0:1775764787.166191:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764787.166214:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5235ab lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5284 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.166252:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.166266:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.166279:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.166398:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed5235ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.166424:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.166434:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:0.0:1775764787.166437:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764787.166441:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d400, rc 0) 00000100:00100000:0.0:1775764787.166520:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46284:x1862023076083968:12345-192.168.202.58@tcp:101:tar.0 Request processed in 358us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764787.166528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6451 00000100:00100000:1.0:1775764787.170370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.170484:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076084096 00000100:00100000:2.0:1775764787.170494:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076084096 00000100:00100000:2.0:1775764787.170556:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6452 00000100:00100000:2.0:1775764787.170565:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46284:x1862023076084096:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:2.0:1775764787.170585:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764787.170606:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5235b9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd528b expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.170667:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5235b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd528b expref: 41 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.170682:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0000/0x6e98bd47ed5235b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd528b expref: 41 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.170715:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764787.170718:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764787.170722:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0000, rc 0) 00000100:00100000:2.0:1775764787.170844:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:46284:x1862023076084096:12345-192.168.202.58@tcp:101:tar.0 Request processed in 280us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764787.170851:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6452 00000100:00100000:2.0:1775764787.177705:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764787.178019:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076084224 00000100:00100000:1.0:1775764787.178031:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076084224 00000100:00100000:1.0:1775764787.178096:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1705 00000100:00100000:1.0:1775764787.178106:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:46284:x1862023076084224:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:1.0:1775764787.178126:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764787.178146:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075bd781f/0x6e98bd47ed5235c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5292 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764787.178172:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1775764787.178192:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764787.178194:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764787.178202:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075bd781f/0x6e98bd47ed5235c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5292 expref: 11 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.178216:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075bd781f/0x6e98bd47ed5235c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5292 expref: 11 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.178230:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4200, rc 0) 00000100:00100000:1.0:1775764787.178345:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:46284:x1862023076084224:12345-192.168.202.58@tcp:101:tar.0 Request processed in 240us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764787.178370:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1705 00000100:00100000:0.0:1775764787.183237:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.183358:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076084480 00000100:00100000:3.0:1775764787.183370:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076084480 00000100:00100000:3.0:1775764787.183555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6453 00000100:00100000:3.0:1775764787.183567:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:46284:x1862023076084480:12345-192.168.202.58@tcp:36:tar.0 00010000:00010000:3.0:1775764787.183677:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.183697:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.183711:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764787.184107:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f224d519 reply state 000000007503f9c7 transno 4294970632 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.184123:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.184148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:3.0:1775764787.184151:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764787.184156:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1775764787.184304:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46284:x1862023076084480:12345-192.168.202.58@tcp:36:tar.0 Request processed in 737us (1075us total) trans 4294970632 rc 0/0 00000100:00100000:3.0:1775764787.184313:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6453 00000100:00100000:2.0:1775764787.187006:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.187156:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076084608 00000100:00100000:3.0:1775764787.187166:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076084608 00000100:00100000:3.0:1775764787.187263:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1706 00000100:00100000:3.0:1775764787.187274:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c74e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2410:x1862023076084608:12345-192.168.202.58@tcp:2:tar.0 00002000:00010000:3.0:1775764787.187426:0:8641:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1775764787.187430:0:8641:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb mtime from disk: 0 -> 1775764784 00002000:00010000:3.0:1775764787.187432:0:8641:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1775764787.187434:0:8641:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb ctime from disk: 0 -> 1775764786 00002000:00010000:3.0:1775764787.187437:0:8641:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1775764787.187501:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c74e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:2410:x1862023076084608:12345-192.168.202.58@tcp:2:tar.0 Request processed in 229us (503us total) trans 4294967721 rc 0/0 00000100:00100000:3.0:1775764787.187508:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1706 00000100:00100000:0.0:1775764787.190412:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.190600:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076084864 00000100:00100000:2.0:1775764787.190612:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076084864 00000100:00100000:2.0:1775764787.190710:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6454 00000100:00100000:2.0:1775764787.190721:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46284:x1862023076084864:12345-192.168.202.58@tcp:55:tar.0 00010000:00010000:2.0:1775764787.190938:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.190957:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.190966:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 4/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.191005:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.191020:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 43 pid: 6521 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764787.191149:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ffa27480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099794688:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764787.191243:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c3a5d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764787.195553:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.195660:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076084992 00000100:00100000:3.0:1775764787.195671:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076084992 00010000:00010000:3.0:1775764787.195713:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 44 pid: 6521 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764787.195938:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1397 00000100:00100000:3.0:1775764787.195948:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2411:x1862023076084992:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764787.195968:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764787.195989:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 44 pid: 6521 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.196004:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 44 pid: 6521 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.196030:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:3.0:1775764787.196035:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.196122:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.196130:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.196151:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764787.196291:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2411:x1862023076084992:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 344us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764787.196299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1397 00010000:00010000:2.0:1775764787.196395:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed5235b2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5284 expref: 43 pid: 6521 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764787.196413:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ffa27480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099794688:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764787.196437:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196447:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196464:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196504:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196511:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196517:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196523:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764787.196527:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196547:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 4/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196557:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764787.196560:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1775764787.196563:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 2/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.196569:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235ce lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764787.196607:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:46284:x1862023076084864:12345-192.168.202.58@tcp:55:tar.0 Request processed in 5888us (6204us total) trans 0 rc -22/-22 00000100:00100000:2.0:1775764787.196615:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6454 00000100:00100000:1.0:1775764787.201169:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764787.201255:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076085120 00000100:00100000:0.0:1775764787.201266:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076085120 00000100:00100000:0.0:1775764787.201344:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6455 00000100:00100000:0.0:1775764787.201353:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:46284:x1862023076085120:12345-192.168.202.58@tcp:101:tar.0 00010000:00010000:0.0:1775764787.201374:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764787.201394:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5235d5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5299 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.201429:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed5235dc lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.201443:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed5235dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.201523:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed5235dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.201646:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5235d5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5299 expref: 44 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.201662:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c600/0x6e98bd47ed5235dc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5299 expref: 43 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764787.201671:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:0.0:1775764787.201674:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764787.201677:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c600, rc 0) 00000100:00100000:0.0:1775764787.201795:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46284:x1862023076085120:12345-192.168.202.58@tcp:101:tar.0 Request processed in 442us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764787.201802:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6455 00000100:00100000:0.0:1775764787.205191:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764787.205289:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076085376 00000100:00100000:1.0:1775764787.205299:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076085376 00000100:00100000:1.0:1775764787.205395:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6456 00000100:00100000:1.0:1775764787.205405:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46284:x1862023076085376:12345-192.168.202.58@tcp:36:tar.0 00010000:00010000:1.0:1775764787.205513:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.205533:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.205547:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1775764787.205726:0:14288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].64, 88 off13152 00000004:00080000:1.0:1775764787.205881:0:14288:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1295027109087ns, next at 1296027105859ns, rc = 0 00000004:00010000:1.0:1775764787.205943:0:14288:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007e35f35b reply state 00000000cfbd58e9 transno 4294970633 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.205958:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764787.205967:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:1.0:1775764787.205970:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1775764787.205975:0:14288:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764787.206304:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:46284:x1862023076085376:12345-192.168.202.58@tcp:36:tar.0 Request processed in 898us (1119us total) trans 4294970633 rc 0/0 00000100:00100000:1.0:1775764787.206312:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6456 00000100:00100000:1.0:1775764787.209677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.210008:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076085504 00000100:00100000:2.0:1775764787.210020:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076085504 00000100:00100000:2.0:1775764787.210208:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1707 00000100:00100000:2.0:1775764787.210219:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:2411:x1862023076085504:12345-192.168.202.58@tcp:2:tar.0 00002000:00010000:2.0:1775764787.210388:0:8405:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1775764787.210392:0:8405:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb mtime from disk: 1775764784 -> 1775764784 00002000:00010000:2.0:1775764787.210394:0:8405:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1775764787.210397:0:8405:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb ctime from disk: 1775764786 -> 1775764786 00002000:00010000:2.0:1775764787.210399:0:8405:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1775764787.210476:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+13:2411:x1862023076085504:12345-192.168.202.58@tcp:2:tar.0 Request processed in 258us (809us total) trans 4294967722 rc 0/0 00000100:00100000:2.0:1775764787.210484:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1707 00000100:00100000:1.0:1775764787.213173:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.213256:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076085760 00000100:00100000:3.0:1775764787.213266:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076085760 00000100:00100000:3.0:1775764787.213325:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6457 00000100:00100000:3.0:1775764787.213336:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:46284:x1862023076085760:12345-192.168.202.58@tcp:36:tar.0 00010000:00010000:3.0:1775764787.213428:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.213446:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.213490:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764787.213637:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002d31bece reply state 0000000002a7475e transno 4294970634 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.213652:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764787.213659:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:3.0:1775764787.213663:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1775764787.213667:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1775764787.213797:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:46284:x1862023076085760:12345-192.168.202.58@tcp:36:tar.0 Request processed in 463us (632us total) trans 4294970634 rc 0/0 00000100:00100000:3.0:1775764787.213804:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6457 00000100:00100000:1.0:1775764787.216550:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.216706:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076085888 00000100:00100000:3.0:1775764787.216717:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076085888 00000100:00100000:0.0:1775764787.217034:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1708 00000100:00100000:0.0:1775764787.217053:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+13:2410:x1862023076085888:12345-192.168.202.58@tcp:2:tar.0 00002000:00010000:0.0:1775764787.217207:0:15167:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1775764787.217211:0:15167:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb mtime from disk: 1775764784 -> 1775764784 00002000:00010000:0.0:1775764787.217213:0:15167:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1775764787.217216:0:15167:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb ctime from disk: 1775764786 -> 1775764786 00002000:00010000:0.0:1775764787.217218:0:15167:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1775764787.217272:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+14:2410:x1862023076085888:12345-192.168.202.58@tcp:2:tar.0 Request processed in 222us (733us total) trans 4294967723 rc 0/0 00000100:00100000:0.0:1775764787.217280:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1708 00000100:00100000:1.0:1775764787.220206:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764787.220328:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076086144 00000100:00100000:3.0:1775764787.220338:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076086144 00000100:00100000:3.0:1775764787.220393:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1353 00000100:00100000:3.0:1775764787.220404:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:46284:x1862023076086144:12345-192.168.202.58@tcp:35:tar.0 00000100:00100000:3.0:1775764787.220711:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:46284:x1862023076086144:12345-192.168.202.58@tcp:35:tar.0 Request processed in 308us (510us total) trans 4294970635 rc 0/0 00000100:00100000:3.0:1775764787.220720:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1353 00000100:00100000:1.0:1775764787.242486:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.242584:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076086400 00000100:00100000:2.0:1775764787.242610:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076086400 00000100:00100000:2.0:1775764787.242674:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6458 00000100:00100000:2.0:1775764787.242684:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:46285:x1862023076086400:12345-192.168.202.58@tcp:101:md5sum.0 00010000:00010000:2.0:1775764787.242709:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764787.242731:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235f1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52a0 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.242876:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.242892:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.242907:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.242917:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.242925:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.242931:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243304:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523606 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243315:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523606 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243322:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523606 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764787.243342:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 158 00010000:00010000:2.0:1775764787.243425:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243432:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243437:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243444:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243450:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764787.243455:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243462:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243474:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x0 (ffff96c2c7e0ff00) 00010000:00010000:2.0:1775764787.243476:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764787.243481:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243487:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5235f8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243500:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243515:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243521:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243526:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764787.243529:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243535:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243544:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:2.0:1775764787.243546:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764787.243548:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 2/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243554:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5235ff lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243594:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed5235f1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52a0 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243606:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1400/0x6e98bd47ed523606 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52a0 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764787.243613:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764787.243616:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764787.243625:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1400, rc 0) 00000100:00100000:2.0:1775764787.243701:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:46285:x1862023076086400:12345-192.168.202.58@tcp:101:md5sum.0 Request processed in 1019us (1228us total) trans 4294970636 rc 0/0 00000100:00100000:2.0:1775764787.243709:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6458 00000100:00100000:1.0:1775764787.249113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764787.249257:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076086656 00000100:00100000:2.0:1775764787.249267:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076086656 00000100:00100000:2.0:1775764787.249330:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1354 00000100:00100000:2.0:1775764787.249341:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:46285:x1862023076086656:12345-192.168.202.58@tcp:35:md5sum.0 00000100:00100000:2.0:1775764787.249669:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+51:46285:x1862023076086656:12345-192.168.202.58@tcp:35:md5sum.0 Request processed in 328us (565us total) trans 4294970637 rc 0/0 00000100:00100000:2.0:1775764787.249678:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1354 00000100:00100000:3.0:1775764788.019806:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1775764788.019828:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099794816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764788.019897:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764788.019980:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099794816 00000100:00100000:3.0:1775764788.019988:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099794816 00000100:00100000:3.0:1775764788.020036:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1775764788.020045:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099794816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764788.020079:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:3.0:1775764788.020139:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099794816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764788.020146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1775764788.020196:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099794816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764788.081976:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764788.354393:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354462:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354495:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354527:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354561:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354741:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354803:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764788.354804:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087296 00000100:00100000:1.0:1775764788.354817:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087296 00000100:00100000:3.0:1775764788.354831:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764788.354870:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764788.354882:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087808 00000100:00100000:1.0:1775764788.354884:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087808 00000100:00100000:3.0:1775764788.354892:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087168 00000100:00100000:3.0:1775764788.354895:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087168 00000100:00100000:1.0:1775764788.354904:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087680 00000100:00100000:1.0:1775764788.354906:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087680 00000100:00100000:3.0:1775764788.354918:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1347 00000100:00100000:3.0:1775764788.354928:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076087296:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764788.354969:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076086784 00000100:00100000:2.0:1775764788.354973:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076086784 00000100:00100000:2.0:1775764788.355001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 955 00000100:00100000:3.0:1775764788.355001:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076087296:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 73us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764788.355007:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076086784:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764788.355061:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087040 00000100:00100000:0.0:1775764788.355073:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087040 00000100:00100000:0.0:1775764788.355105:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087552 00000100:00100000:0.0:1775764788.355107:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087552 00000100:00100000:0.0:1775764788.355125:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076086912 00000100:00100000:0.0:1775764788.355128:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076086912 00000100:00100000:0.0:1775764788.355143:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087424 00000100:00100000:0.0:1775764788.355146:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087424 00000100:00100000:0.0:1775764788.355160:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1857 00000100:00100000:0.0:1775764788.355166:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076087040:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764788.355211:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076087040:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 33us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.355218:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1857 00000100:00100000:0.0:1775764788.355237:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1858 00000100:00100000:0.0:1775764788.355243:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2410:x1862023076087552:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764788.355268:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2410:x1862023076087552:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.355274:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1858 00000100:00100000:0.0:1775764788.355286:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1859 00000100:00100000:0.0:1775764788.355291:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+57:2410:x1862023076086912:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764788.355321:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+57:2410:x1862023076086912:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.355326:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1859 00000100:00100000:0.0:1775764788.355337:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1860 00000100:00100000:0.0:1775764788.355342:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+51:2410:x1862023076087424:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764788.355366:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+51:2410:x1862023076087424:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.355379:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1860 00000100:00100000:2.0:1775764788.355590:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076086784:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 581us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764788.355597:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 955 00000100:00100000:1.0:1775764788.356593:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1348 00000100:00100000:1.0:1775764788.356611:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+14:2410:x1862023076087808:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764788.356659:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+14:2410:x1862023076087808:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 56us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.356667:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1348 00000100:00100000:1.0:1775764788.356686:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1349 00000100:00100000:1.0:1775764788.356693:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076087168:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764788.356716:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076087168:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.356722:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1349 00000100:00100000:1.0:1775764788.356746:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1350 00000100:00100000:1.0:1775764788.356752:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076087680:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764788.356796:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076087680:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 44us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.356816:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1350 00000100:00080000:1.0:1775764788.357053:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1775764788.357061:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1775764788.357065:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764788.361049:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1347 00000100:00100000:1.0:1775764788.539557:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099794944:0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.539643:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.539859:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099795072:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.539893:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.539943:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099795584:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.539961:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.539977:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099796096:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.539996:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.540036:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775764788.540042:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099795456:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.540068:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.540084:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099795968:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.540105:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.540123:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099796480:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.540152:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.540181:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099795200:0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.540340:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795968 00000100:00100000:1.0:1775764788.540347:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795968 00000100:00100000:1.0:1775764788.540398:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796480 00000100:00100000:1.0:1775764788.540411:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796480 00000100:00100000:1.0:1775764788.540436:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1775764788.540444:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.540505:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099795968:12345-0@lo:400:kworker.0 Request processed in 61us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.540511:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1775764788.540529:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1775764788.540534:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099796480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.540562:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099796480:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.540567:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00080000:1.0:1775764788.540599:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764788.540603:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764788.540934:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099795328:0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.540965:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764788.540986:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099795840:0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.541003:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764788.541043:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099796352:0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.541068:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764788.541099:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795840 00000100:00100000:1.0:1775764788.541103:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795840 00000100:00080000:1.0:1775764788.541119:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764788.541141:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796352 00000100:00100000:1.0:1775764788.541144:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796352 00000100:00100000:1.0:1775764788.541164:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1775764788.541169:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.541352:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099795840:12345-0@lo:400:kworker.0 Request processed in 182us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.541360:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1775764788.541379:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1775764788.541386:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099796352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.541434:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099796352:12345-0@lo:400:kworker.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.541441:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00080000:1.0:1775764788.541459:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764788.541488:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099795840:0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.541500:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099796352:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542311:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.542366:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099795712:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542402:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.542424:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099796224:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542445:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764788.542487:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795072 00000100:00100000:0.0:1775764788.542493:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795072 00000100:00100000:0.0:1775764788.542528:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795584 00000100:00100000:0.0:1775764788.542531:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795584 00000100:00100000:0.0:1775764788.542565:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796096 00000100:00100000:0.0:1775764788.542568:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796096 00000100:00100000:0.0:1775764788.542583:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795328 00000100:00100000:0.0:1775764788.542585:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795328 00000100:00100000:0.0:1775764788.542596:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795712 00000100:00100000:0.0:1775764788.542599:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795712 00000100:00100000:0.0:1775764788.542609:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796224 00000100:00100000:0.0:1775764788.542611:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796224 00000100:00100000:0.0:1775764788.542625:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:0.0:1775764788.542631:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099795072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542672:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099795072:12345-0@lo:400:kworker.0 Request processed in 41us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.542679:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:0.0:1775764788.542694:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:0.0:1775764788.542701:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099795584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542738:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099795584:12345-0@lo:400:kworker.0 Request processed in 38us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.542744:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:0.0:1775764788.542756:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:0.0:1775764788.542761:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099796096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542825:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099796096:12345-0@lo:400:kworker.0 Request processed in 64us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.542831:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:0.0:1775764788.542843:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:0.0:1775764788.542849:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099795328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542881:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099795328:12345-0@lo:400:kworker.0 Request processed in 33us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.542895:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:0.0:1775764788.542907:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:0.0:1775764788.542913:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542948:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099795712:12345-0@lo:400:kworker.0 Request processed in 35us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.542954:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:0.0:1775764788.542965:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:0.0:1775764788.542972:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099796224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.542997:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099796224:12345-0@lo:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764788.543002:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1775764788.546491:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795456 00000100:00100000:1.0:1775764788.546509:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795456 00000100:00100000:1.0:1775764788.546576:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099795200 00000100:00100000:1.0:1775764788.546579:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099795200 00000100:00100000:1.0:1775764788.546600:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1775764788.546610:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.546706:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099795456:12345-0@lo:400:kworker.0 Request processed in 97us (6635us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.546721:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1775764788.546768:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1775764788.546803:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099795200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764788.546837:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099795200:12345-0@lo:400:kworker.0 Request processed in 45us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764788.546843:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00080000:0.0:1775764788.547304:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764788.547309:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764788.547355:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099795328:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.547395:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099795456:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549007:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099795968:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549524:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099796480:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549540:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099795072:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549551:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099795584:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549563:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099796096:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549638:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099795200:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549649:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099795712:0@lo:400:kworker.0 00000100:00100000:0.0:1775764788.549682:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099796224:0@lo:400:kworker.0 00000100:00100000:2.0:1775764788.550506:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099794944 00000100:00100000:2.0:1775764788.550515:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099794944 00000100:00100000:2.0:1775764788.550572:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1775764788.550583:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764788.550748:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099794944:12345-0@lo:400:kworker.0 Request processed in 167us (11106us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764788.550766:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1775764788.563057:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099794944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764789.066342:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099796608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764789.066428:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764789.066512:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796608 00000100:00100000:2.0:1775764789.066519:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796608 00000100:00100000:2.0:1775764789.066559:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1775764789.066565:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ffa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099796608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764789.066593:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 501788864 pending 36864 free 3886542848 avail 3655020544 00000100:00100000:2.0:1775764789.066632:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ffa24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099796608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764789.066639:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1775764789.066688:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099796608:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1775764789.067063:0:9674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1296888291152ns, next at 1297888288564ns, rc = 0 00000100:00100000:0.0:1775764789.067160:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099796736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764789.067208:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764789.067645:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796736 00000100:00100000:2.0:1775764789.067652:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796736 00000100:00100000:2.0:1775764789.067702:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1775764789.067710:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099796736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764789.067738:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 501788864 pending 36864 free 3886542848 avail 3655020544 00000100:00100000:2.0:1775764789.067801:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099796736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764789.067817:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1775764789.067998:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ffa27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099796736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1775764789.125023:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764790.131210:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764791.096864:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099796864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1775764791.096948:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764791.097037:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796864 00000100:00100000:1.0:1775764791.097045:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796864 00000100:00100000:1.0:1775764791.097087:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1775764791.097095:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099796864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764791.097132:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444237312 avail 1297997824 00000100:00100000:1.0:1775764791.097189:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099796864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764791.097195:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1775764791.097251:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099796864:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764791.154556:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764792.114051:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099796992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1775764792.114141:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764792.114437:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099796992 00000100:00100000:1.0:1775764792.114447:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099796992 00000100:00100000:1.0:1775764792.114524:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1775764792.114535:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ffa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099796992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764792.114574:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41332928 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764792.114630:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ffa27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099796992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764792.114637:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000004:00080000:3.0:1775764792.114804:0:8640:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1299936030809ns, next at 1300935995866ns, rc = 0 00000100:00080000:2.0:1775764792.115466:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764792.115487:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099797120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764792.115634:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764792.115731:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099796992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764792.116120:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099797120 00000100:00100000:1.0:1775764792.116127:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099797120 00000100:00100000:1.0:1775764792.116174:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1775764792.116183:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099797120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764792.116206:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41332928 pending 0 free 3916955648 avail 3685433344 00000100:00080000:2.0:1775764792.116661:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764792.118010:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099797120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1821us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764792.118022:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1775764792.118314:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099797120:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1775764792.120591:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000004:00080000:3.0:1775764792.120613:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000001:00080000:3.0:1775764792.120648:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970637 is committed 00000004:00080000:3.0:1775764792.120660:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000001:00080000:3.0:1775764792.120688:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970622 is committed 00000020:00080000:3.0:1775764792.120713:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2c6205b40 refcount 2 committed 0 result 0 batchid 123 00000020:00080000:3.0:1775764792.120718:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2d85e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2c17300 00000020:00080000:3.0:1775764792.120721:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2d85f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c2d88bcc00 00000020:00080000:3.0:1775764792.120736:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 122 batchid updated 00010000:00010000:3.0:1775764792.120758:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764792.120786:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764792.120795:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764792.120802:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764792.120807:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764792.120815:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764792.120840:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9c:0x0].0x0 (ffff96c2c7e0f400) 00010000:00010000:3.0:1775764792.120843:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764792.120849:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764792.120871:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5234a1 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120898:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120906:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120912:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120917:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00000020:00080000:3.0:1775764792.120917:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 123 committed batchid 122 00010000:00010000:2.0:1775764792.120920:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120926:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120935:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:2.0:1775764792.120938:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764792.120940:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120945:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523518 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120959:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120964:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120981:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120986:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00000020:00080000:3.0:1775764792.120987:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 122 00010000:00010000:2.0:1775764792.120989:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.120995:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121003:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xa:0x0].0x3a10107c (ffff96c2c7e0f200) 00010000:00010000:2.0:1775764792.121005:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764792.121007:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121012:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed52355e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xa:0x0].0x3a10107c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121029:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121034:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121039:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764792.121042:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099797248:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1775764792.121045:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764792.121048:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121061:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121070:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764792.121072:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1775764792.121074:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121079:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523581 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121089:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121094:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121099:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121104:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764792.121106:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121110:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764792.121116:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1775764792.121117:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764792.121119:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764792.121121:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121134:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5235c7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121145:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121150:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121156:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121160:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764792.121178:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121186:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121198:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764792.121200:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1775764792.121203:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121208:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5235e3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121218:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121225:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121248:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121254:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764792.121257:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121263:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121271:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff96c2c6356200) 00010000:00010000:2.0:1775764792.121273:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1775764792.121275:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.121281:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5235ea lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764792.121293:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099797376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1775764792.121321:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099797248 00000100:00100000:2.0:1775764792.121330:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099797248 00000100:00100000:1.0:1775764792.121337:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764792.121509:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099797376 00000100:00100000:1.0:1775764792.121513:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099797376 00000100:00100000:1.0:1775764792.121562:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1775764792.121571:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099797376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1775764792.121684:0:8403:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1775764792.121687:0:8403:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb mtime from disk: 1775764784 -> 1775764784 00002000:00010000:1.0:1775764792.121690:0:8403:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1775764792.121702:0:8403:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb ctime from disk: 1775764786 -> 1775764786 00002000:00010000:1.0:1775764792.121705:0:8403:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x55:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1775764792.121743:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099797376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (405us total) trans 4294967724 rc 0/0 00000100:00100000:1.0:1775764792.121751:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00080000:1.0:1775764792.121794:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1775764792.121985:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c1c561d500/2, rc 0, transno 4294967724 00000100:00100000:1.0:1775764792.121998:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099797376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1775764792.122877:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:2.0:1775764792.122890:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c408dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3663:x1862023099797248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1775764792.122914:0:8641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:84 count 1 00010000:00010000:2.0:1775764792.122938:0:8641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.122960:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.122978:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764792.122981:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764792.122985:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.123019:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 6 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.123034:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 6 pid: 8641 timeout: 1399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764792.123048:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099797504:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764792.123116:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b2ae40 going to sleep for 11 seconds 00000001:00080000:1.0:1775764792.127723:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967724 is committed 00000001:00080000:1.0:1775764792.127738:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967723 is committed 00000100:00100000:3.0:1775764792.136347:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764792.136848:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076087936 00000100:00100000:1.0:1775764792.136858:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076087936 00010000:00010000:1.0:1775764792.138662:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 7 pid: 8641 timeout: 1399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764792.138731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1398 00000100:00100000:1.0:1775764792.138747:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c408ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076087936:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764792.138790:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764792.138799:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 7 pid: 8641 timeout: 1399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764792.138829:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 7 pid: 8641 timeout: 1399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764792.138866:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764792.138869:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764792.138875:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764792.138887:0:6506:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764792.138918:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764792.139019:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c408ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076087936:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 276us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764792.139051:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1398 00010000:00010000:2.0:1775764792.139360:0:8641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5234d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd524c expref: 6 pid: 8641 timeout: 1399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764792.139392:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099797504:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764792.139429:0:8641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139441:0:8641:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139448:0:8641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139465:0:8641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139473:0:8641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139492:0:8641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1775764792.139663:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c408dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3663:x1862023099797248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16776us (18546us total) trans 4294967724 rc 0/0 00000100:00100000:2.0:1775764792.139671:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00010000:00010000:2.0:1775764792.139703:0:6509:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1775764792.139709:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139717:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0c00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764792.139722:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139731:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139744:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139751:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faec2631/0x6e98bd47ed523614 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764792.139790:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764792.139792:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764792.139794:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1775764792.139980:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c1c72e5c00/2, rc 0, transno 4294967724 00000100:00100000:2.0:1775764792.139987:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099797248:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1775764792.144666:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1775764792.147804:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967724 is committed 00000001:00080000:3.0:1775764792.147824:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967722 is committed 00010000:00010000:2.0:1775764792.178289:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764792.452127:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764792.452197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764792.452344:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088064 00000100:00100000:2.0:1775764792.452357:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088064 00002000:00100000:2.0:1775764792.452439:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x55:0x0] (0->157) req@ffff96c1c561fb80 x1862023076088064/t0(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:273/0 lens 648/0 e 0 to 0 dl 1775764803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764792.452451:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c561fb80 with x1862023076088064 ext(0->157) 00002000:00010000:2.0:1775764792.452456:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c561fb80 00000100:00100000:2.0:1775764792.452486:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 431 00000100:00100000:2.0:1775764792.452496:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076088064:12345-192.168.202.58@tcp:4:md5sum.0 00000100:00100000:3.0:1775764792.453098:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088192 00000100:00100000:3.0:1775764792.453105:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088192 00000100:00100000:3.0:1775764792.453145:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1711 00000100:00100000:3.0:1775764792.453152:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:2409:x1862023076088192:12345-192.168.202.58@tcp:16:kworker.0 00000100:00080000:1.0:1775764792.454841:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764792.455106:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:2409:x1862023076088064:12345-192.168.202.58@tcp:4:md5sum.0 Request processed in 2604us (2983us total) trans 4294967725 rc 0/0 00000100:00100000:3.0:1775764792.455119:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 431 00002000:00100000:3.0:1775764792.455132:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x55:0x0] (0->157) req@ffff96c1c561fb80 x1862023076088064/t4294967725(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:273/0 lens 648/448 e 0 to 0 dl 1775764803 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764792.455143:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c561fb80 with x1862023076088064 ext(0->157) 00002000:00010000:3.0:1775764792.455149:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c561fb80 00000001:00080000:1.0:1775764792.457358:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967725 is committed 00000100:00100000:3.0:1775764792.458101:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076088192:12345-192.168.202.58@tcp:16:kworker.0 Request processed in 4940us (5894us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764792.458114:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1711 00000100:00100000:0.0:1775764793.142834:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099797632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764793.142923:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764793.143163:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099797632 00000100:00100000:3.0:1775764793.143172:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099797632 00000100:00100000:3.0:1775764793.143230:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1775764793.143240:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099797632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764793.143277:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:3.0:1775764793.143339:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099797632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764793.143346:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1775764793.144207:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099797632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1775764793.209048:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764793.394363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.394440:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088320 00000100:00100000:0.0:1775764793.394453:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088320 00000100:00100000:0.0:1775764793.394550:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6459 00000100:00100000:0.0:1775764793.394564:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+47:46259:x1862023076088320:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764793.394698:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+47:46259:x1862023076088320:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 136us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764793.394707:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6459 00000100:00080000:1.0:1775764793.395017:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764793.402171:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764793.402262:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088448 00000100:00100000:3.0:1775764793.402274:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088448 00000100:00100000:3.0:1775764793.402363:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6460 00000100:00100000:3.0:1775764793.402374:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:46259:x1862023076088448:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1775764793.402483:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:46259:x1862023076088448:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764793.402492:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6460 00000100:00080000:1.0:1775764793.402605:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764793.481839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.481879:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.481913:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.481959:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.481985:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.482003:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.482025:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764793.482057:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088576 00000100:00100000:0.0:1775764793.482067:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088576 00000100:00100000:0.0:1775764793.482120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 957 00000100:00100000:0.0:1775764793.482146:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076088576:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764793.482220:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076088576:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764793.482228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 957 00000100:00100000:2.0:1775764793.482483:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088960 00000100:00100000:2.0:1775764793.482489:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088960 00000100:00100000:2.0:1775764793.482536:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076089088 00000100:00100000:2.0:1775764793.482539:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076089088 00000100:00100000:2.0:1775764793.482561:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1867 00000100:00100000:2.0:1775764793.482568:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:2408:x1862023076088960:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764793.482601:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:2408:x1862023076088960:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.482607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1867 00000100:00100000:2.0:1775764793.482621:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1868 00000100:00100000:2.0:1775764793.482634:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076089088:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764793.482660:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2408:x1862023076089088:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.482666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1868 00000100:00100000:2.0:1775764793.482712:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088704 00000100:00100000:2.0:1775764793.482716:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088704 00000100:00100000:2.0:1775764793.482740:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076089216 00000100:00100000:2.0:1775764793.482742:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076089216 00000100:00100000:2.0:1775764793.482756:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076088832 00000100:00100000:2.0:1775764793.482758:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076088832 00000100:00100000:2.0:1775764793.482807:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076089344 00000100:00100000:2.0:1775764793.482810:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076089344 00000100:00100000:2.0:1775764793.482827:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1355 00000100:00100000:2.0:1775764793.482834:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076088704:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764793.482862:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076088704:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.482868:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1355 00000100:00100000:2.0:1775764793.482883:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1356 00000100:00100000:2.0:1775764793.482889:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076089216:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764793.482911:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076089216:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.482917:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1356 00000100:00100000:2.0:1775764793.482927:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1357 00000100:00100000:2.0:1775764793.482933:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076088832:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764793.482954:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076088832:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.482967:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1357 00000100:00100000:2.0:1775764793.482979:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1358 00000100:00100000:2.0:1775764793.482986:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076089344:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764793.483011:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076089344:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.483018:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1358 00000100:00080000:0.0:1775764793.484393:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764793.484400:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1775764793.484403:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764793.484406:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764793.650226:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099797888:0@lo:400:kworker.0 00000100:00100000:3.0:1775764793.650297:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764793.650461:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099797760:0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.650502:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.650584:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099798144:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.650616:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.650663:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099798016:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.650722:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.650758:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798016 00000100:00100000:1.0:1775764793.650766:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798016 00000100:00100000:1.0:1775764793.650842:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1775764793.650848:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099798016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.650898:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099798016:12345-0@lo:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.650904:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1775764793.651016:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099797888 00000100:00100000:2.0:1775764793.651021:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099797888 00000100:00100000:3.0:1775764793.651089:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099798400:0@lo:400:kworker.0 00000100:00100000:3.0:1775764793.651110:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764793.653020:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099797760 00000100:00100000:0.0:1775764793.653034:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099797760 00000100:00100000:0.0:1775764793.653104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1775764793.653114:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c2a47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099797760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.653200:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c2a47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099797760:12345-0@lo:400:kworker.0 Request processed in 88us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764793.653207:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1775764793.653279:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798144 00000100:00100000:0.0:1775764793.653283:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798144 00000100:00100000:1.0:1775764793.654251:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798400 00000100:00100000:1.0:1775764793.654260:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798400 00000100:00100000:2.0:1775764793.654788:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:2.0:1775764793.654804:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099797888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764793.654897:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099797888:12345-0@lo:400:kworker.0 Request processed in 99us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.654904:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:0.0:1775764793.655273:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1775764793.655283:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099798144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.655326:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099798144:12345-0@lo:400:kworker.0 Request processed in 46us (4709us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764793.655333:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00080000:0.0:1775764793.655380:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764793.655803:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:1.0:1775764793.655815:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099798400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.655858:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099798400:12345-0@lo:400:kworker.0 Request processed in 47us (4745us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.655885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:3.0:1775764793.656032:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099798400:0@lo:400:kworker.0 00000100:00100000:3.0:1775764793.656046:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099798912:0@lo:400:kworker.0 00000100:00100000:3.0:1775764793.656084:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.656148:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798912 00000100:00100000:1.0:1775764793.656155:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798912 00000100:00100000:1.0:1775764793.656195:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1775764793.656201:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099798912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.656233:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099798912:12345-0@lo:400:kworker.0 Request processed in 32us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.656238:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00080000:1.0:1775764793.656252:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764793.656298:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099797760:0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.656317:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099798272:0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.656364:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764793.656388:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099798784:0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.656410:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764793.656429:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099799296:0@lo:400:kworker.0 00000100:00100000:3.0:1775764793.656445:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099798912:0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.656449:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764793.656479:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099797888:0@lo:400:kworker.0 00000100:00100000:2.0:1775764793.657078:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798784 00000100:00100000:2.0:1775764793.657086:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798784 00000100:00100000:2.0:1775764793.657120:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799296 00000100:00100000:2.0:1775764793.657123:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799296 00000100:00100000:2.0:1775764793.657144:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1775764793.657151:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099798784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764793.657262:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1775764793.657273:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099799296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.657296:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099798144:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.657306:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099798656:0@lo:400:kworker.0 00000100:00100000:0.0:1775764793.657661:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798272 00000100:00100000:0.0:1775764793.657667:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798272 00000100:00100000:0.0:1775764793.657712:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1775764793.657719:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099798272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.657904:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.657935:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099799168:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.657966:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.658018:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798656 00000100:00100000:1.0:1775764793.658021:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798656 00000100:00100000:1.0:1775764793.658040:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799168 00000100:00100000:1.0:1775764793.658043:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799168 00000100:00100000:1.0:1775764793.658066:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1775764793.658071:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099798656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.658105:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099798656:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.658112:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1775764793.658125:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1775764793.658131:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f6793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099799168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.658178:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f6793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099799168:12345-0@lo:400:kworker.0 Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.658184:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00080000:1.0:1775764793.658204:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764793.658229:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099798016:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.658242:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099798528:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.658269:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.658290:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099799040:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.658310:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764793.658365:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099798528 00000100:00100000:1.0:1775764793.658370:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099798528 00000100:00100000:1.0:1775764793.658403:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799040 00000100:00100000:1.0:1775764793.658406:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799040 00000100:00100000:1.0:1775764793.658425:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1775764793.658431:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099798528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.658475:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099798528:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.658482:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1775764793.659049:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1775764793.659060:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099799040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.659099:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099799040:12345-0@lo:400:kworker.0 Request processed in 43us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764793.659106:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00080000:1.0:1775764793.659129:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764793.659157:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099798528:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.659185:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099799040:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.659225:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099798656:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.659236:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099799168:0@lo:400:kworker.0 00000100:00100000:2.0:1775764793.659562:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099798784:12345-0@lo:400:kworker.0 Request processed in 2409us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764793.659570:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1775764793.660706:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099798272:12345-0@lo:400:kworker.0 Request processed in 2980us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764793.660706:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099799296:12345-0@lo:400:kworker.0 Request processed in 3429us (4248us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764793.660718:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1775764793.660718:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1775764793.660985:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099798272:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.661001:0:3662:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967724 gen 2 00000004:00080000:1.0:1775764793.661007:0:3662:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967723 committed transno 4294967724 00000004:00080000:1.0:1775764793.661029:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c1c72e5c00, transno 4294967724 00000100:00100000:1.0:1775764793.661092:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099798784:0@lo:400:kworker.0 00000100:00100000:1.0:1775764793.661107:0:3662:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967724 gen 2 00000004:00080000:1.0:1775764793.661110:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c1c561d500, transno 4294967724 00000100:00100000:1.0:1775764793.661127:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099799296:0@lo:400:kworker.0 00000100:00100000:0.0:1775764794.164159:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099799552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764794.164236:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764794.164316:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764794.164323:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099799424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764794.164351:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764794.164428:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799552 00000100:00100000:1.0:1775764794.164439:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799552 00000100:00100000:1.0:1775764794.164519:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799424 00000100:00100000:1.0:1775764794.164522:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799424 00000100:00100000:1.0:1775764794.164555:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1775764794.164565:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099799552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764794.164589:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886542848 avail 3654991872 00000100:00100000:1.0:1775764794.164648:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099799552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764794.164657:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1775764794.164684:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1775764794.164692:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099799424:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1775764794.164699:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1775764794.164707:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886542848 avail 3654991872 00000100:00100000:1.0:1775764794.164752:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099799424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764794.164758:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1775764794.165286:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099799424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764794.165302:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099799552:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1775764794.226269:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764795.250363:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764795.250384:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764795.250493:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 149 count 3 00000040:00080000:3.0:1775764795.250502:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1775764795.254347:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1775764795.575727:0:30121:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 15:59:53 (1775764793) 00000100:00100000:1.0:1775764796.105828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764796.105988:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076089600 00000100:00100000:0.0:1775764796.106001:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076089600 00000100:00100000:0.0:1775764796.106077:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6461 00000100:00100000:0.0:1775764796.106087:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+47:46899:x1862023076089600:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764796.106122:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764796.106145:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed52361b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52a7 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106238:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106255:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106268:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106284:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106291:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106298:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106415:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523630 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106426:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523630 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106432:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523630 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764796.106442:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1775764796.106904:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106914:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106921:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106929:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764796.106933:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106941:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106955:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:0.0:1775764796.106959:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764796.106964:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106970:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523622 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106982:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106989:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.106995:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107011:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764796.107014:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107020:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107028:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c2c6356b00) 00010000:00010000:0.0:1775764796.107030:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764796.107033:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107038:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523629 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107313:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed52361b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52a7 expref: 50 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107329:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523630 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52a7 expref: 49 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.107349:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764796.107351:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764796.107353:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ce00, rc 0) 00000100:00080000:1.0:1775764796.107520:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764796.107870:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:46899:x1862023076089600:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1782us (2053us total) trans 4294970638 rc 0/0 00000100:00100000:0.0:1775764796.107882:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6461 00000100:00100000:1.0:1775764796.119260:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.119585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764796.119687:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076089728 00000100:00100000:3.0:1775764796.119700:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076089728 00000100:00100000:3.0:1775764796.119828:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 744 00000100:00100000:3.0:1775764796.119842:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:2409:x1862023076089728:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764796.119861:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764796.119889:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523630 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52a7 expref: 49 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.119911:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764796.119917:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764796.119974:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:2409:x1862023076089728:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 136us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764796.119983:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 744 00000100:00100000:2.0:1775764796.121256:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076089984 00000100:00100000:2.0:1775764796.121266:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076089984 00000100:00100000:2.0:1775764796.121325:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1355 00000100:00100000:2.0:1775764796.121354:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:46899:x1862023076089984:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764796.122251:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:46899:x1862023076089984:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 894us (2998us total) trans 4294970639 rc 0/0 00000100:00100000:2.0:1775764796.122261:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1355 00000100:00100000:1.0:1775764796.125397:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764796.125649:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076090112 00000100:00100000:2.0:1775764796.125674:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076090112 00000100:00100000:2.0:1775764796.125737:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6462 00000100:00100000:2.0:1775764796.126141:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+49:46899:x1862023076090112:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1775764796.126968:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+49:46899:x1862023076090112:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 1207us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764796.126980:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6462 00000100:00100000:3.0:1775764796.135108:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.135267:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076090240 00000100:00100000:1.0:1775764796.135278:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076090240 00000100:00100000:1.0:1775764796.135369:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6463 00000100:00100000:1.0:1775764796.135380:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:46899:x1862023076090240:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764796.135500:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:46899:x1862023076090240:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764796.135508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6463 00000100:00080000:3.0:1775764796.136554:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764796.144157:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.144604:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076090368 00000100:00100000:1.0:1775764796.144616:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076090368 00000100:00100000:1.0:1775764796.144763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6464 00000100:00100000:1.0:1775764796.144816:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46900:x1862023076090368:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764796.144844:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764796.144868:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52363e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52ae expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.144946:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.144989:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145001:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145038:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145046:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145054:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145103:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145111:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145117:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145124:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145131:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.145135:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145143:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145162:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764796.145165:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.145170:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145177:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145192:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145198:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145204:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145210:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.145213:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145220:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145227:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93e911e6 (ffff96c2c7ea7500) 00010000:00010000:1.0:1775764796.145229:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.145232:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145238:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52364c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145282:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52363e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ae expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764796.145296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.145300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52363e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ae expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.145309:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5000, rc 0) 00000100:00100000:1.0:1775764796.145388:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46900:x1862023076090368:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 615us (1241us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764796.145397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6464 00000100:00080000:3.0:1775764796.145470:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764796.154906:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764796.156109:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076090624 00000100:00100000:0.0:1775764796.156140:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076090624 00000100:00100000:0.0:1775764796.156219:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6465 00000100:00100000:0.0:1775764796.156231:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+30:46900:x1862023076090624:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:0.0:1775764796.156296:0:10088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764796.156338:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5231bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5142 expref: 30 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.156358:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764796.156364:0:10088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764796.156428:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.156444:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.156452:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.156491:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.156506:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 48 pid: 14288 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764796.156520:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099799680:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764796.156620:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c45cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764796.168545:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764796.168611:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076090752 00000100:00100000:0.0:1775764796.168633:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076090752 00000100:00100000:3.0:1775764796.168635:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099799680:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764796.168680:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168693:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 49 pid: 14288 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764796.168754:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1399 00000100:00100000:0.0:1775764796.168765:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:2411:x1862023076090752:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764796.168807:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764796.168816:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 49 pid: 14288 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168830:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 49 pid: 14288 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168855:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52322b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd515e expref: 49 pid: 14288 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168871:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764796.168876:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168886:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168895:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.168923:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764796.168977:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:2411:x1862023076090752:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 213us (443us total) trans 0 rc 0/0 00010000:00010000:3.0:1775764796.168978:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.168990:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764796.169005:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1399 00010000:00010000:3.0:1775764796.169022:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169033:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169041:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169598:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169611:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169618:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764796.169635:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c8db4ac4 reply state 00000000f14bcfe1 transno 4294970640 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169667:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169675:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:3.0:1775764796.169679:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764796.169683:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1775764796.169690:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 4096 00010000:00010000:3.0:1775764796.169700:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169707:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169713:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169720:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764796.169725:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169733:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169744:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764796.169747:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764796.169751:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169796:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed523653 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764796.169821:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c8db4ac4 reply state 00000000f14bcfe1 transno 4294970640 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169830:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.169847:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93e911e6 (ffff96c1c2a03200) 00010000:00010000:3.0:1775764796.169850:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764796.169852:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1775764796.169934:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:46900:x1862023076090624:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 13704us (15041us total) trans 4294970640 rc 0/0 00000100:00100000:3.0:1775764796.169942:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6465 00000100:00100000:0.0:1775764796.180841:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764796.180935:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076090880 00000100:00100000:2.0:1775764796.180950:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076090880 00000100:00100000:2.0:1775764796.181026:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6466 00000100:00100000:2.0:1775764796.181036:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+31:46901:x1862023076090880:12345-192.168.202.58@tcp:101:chmod.0 00010000:00010000:2.0:1775764796.181068:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764796.181096:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52b5 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.181173:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.181190:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.181203:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764796.181278:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1775764796.181282:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764796.181306:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.181328:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 33 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.181346:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 32 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.181355:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764796.181357:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764796.181361:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0a00, rc 0) 00000100:00100000:2.0:1775764796.181436:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46901:x1862023076090880:12345-192.168.202.58@tcp:101:chmod.0 Request processed in 401us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764796.181443:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6466 00000100:00100000:0.0:1775764796.186499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.186590:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076091008 00000100:00100000:1.0:1775764796.186601:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076091008 00000100:00100000:1.0:1775764796.186672:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6467 00000100:00100000:1.0:1775764796.186682:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c638e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+32:46901:x1862023076091008:12345-192.168.202.58@tcp:101:chmod.0 00010000:00010000:1.0:1775764796.186703:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764796.186726:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52bc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.186851:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.186866:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.186878:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.186909:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.186917:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.186924:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187007:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52368b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187015:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52368b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187022:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52368b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764796.187057:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 4096 00000004:00200000:1.0:1775764796.187061:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764796.187086:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52368b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187099:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187104:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187110:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187125:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187130:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.187134:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187140:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187152:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764796.187155:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.187160:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187166:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed52367d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187179:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187185:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187191:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187195:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.187197:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187213:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187222:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93e911e6 (ffff96c1c2a03200) 00010000:00010000:1.0:1775764796.187223:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.187226:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187230:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187256:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52bc expref: 34 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187268:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52368b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52bc expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.187275:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764796.187277:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764796.187279:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5a00, rc 0) 00000100:00100000:1.0:1775764796.187336:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c638e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:46901:x1862023076091008:12345-192.168.202.58@tcp:101:chmod.0 Request processed in 656us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764796.187344:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6467 00000100:00100000:0.0:1775764796.193333:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764796.193407:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076091264 00000100:00100000:3.0:1775764796.193418:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076091264 00000100:00100000:3.0:1775764796.193477:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6468 00000100:00100000:3.0:1775764796.193487:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:46901:x1862023076091264:12345-192.168.202.58@tcp:36:chmod.0 00010000:00010000:3.0:1775764796.193550:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764796.193584:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52368b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52bc expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.193603:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:3.0:1775764796.193608:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764796.193634:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.193647:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.193689:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764796.193913:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d9b98724 reply state 000000002c7dd2c0 transno 4294970641 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.193926:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.193931:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:3.0:1775764796.193934:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1775764796.193937:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1775764796.193945:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 4096 00000100:00100000:3.0:1775764796.194034:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46901:x1862023076091264:12345-192.168.202.58@tcp:36:chmod.0 Request processed in 548us (710us total) trans 4294970641 rc 0/0 00000100:00100000:3.0:1775764796.194041:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6468 00000100:00100000:0.0:1775764796.210812:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764796.210839:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099799808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764796.210911:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764796.211098:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799808 00000100:00100000:3.0:1775764796.211106:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799808 00000100:00100000:3.0:1775764796.211156:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1775764796.211163:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099799808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764796.211194:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444233216 avail 1297993728 00000100:00100000:3.0:1775764796.211245:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099799808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764796.211252:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1775764796.211407:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099799808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764796.212352:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.212474:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076091392 00000100:00100000:1.0:1775764796.212481:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076091392 00000100:00100000:1.0:1775764796.212526:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6469 00000100:00100000:1.0:1775764796.212534:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46903:x1862023076091392:12345-192.168.202.58@tcp:101:tee.0 00010000:00010000:1.0:1775764796.212567:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764796.212588:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523699 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212677:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212688:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212699:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212706:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212713:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212822:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5236ae lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212837:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5236ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212844:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5236ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764796.212875:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 4096 00000004:00200000:1.0:1775764796.212883:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764796.212921:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5236ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212933:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212939:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.212945:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213137:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213144:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.213148:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213156:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213167:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764796.213170:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.213175:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213181:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed5236a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213193:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213208:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213214:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213219:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.213221:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213227:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213233:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93e911e6 (ffff96c1c2a03200) 00010000:00010000:1.0:1775764796.213235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.213238:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213243:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed5236a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213268:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523699 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52c3 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213279:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5e00/0x6e98bd47ed5236ae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52c3 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.213286:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764796.213289:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1775764796.213294:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5e00, rc 0) 00000100:00100000:1.0:1775764796.213339:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:46903:x1862023076091392:12345-192.168.202.58@tcp:101:tee.0 Request processed in 806us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764796.213346:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6469 00000100:00100000:2.0:1775764796.216241:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.217163:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076091648 00000100:00100000:1.0:1775764796.217176:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076091648 00000100:00100000:1.0:1775764796.217237:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6470 00000100:00100000:1.0:1775764796.217246:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:46903:x1862023076091648:12345-192.168.202.58@tcp:101:tee.0 00010000:00010000:1.0:1775764796.217270:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764796.217293:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236b5 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52ca expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.217420:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.217437:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.217448:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.217462:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.217468:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.217475:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764796.220906:0:6522:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x55:0x0], index 0: 0 00010000:00010000:1.0:1775764796.221358:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5236ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221375:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5236ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221387:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5236ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221429:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221435:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221441:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221447:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221453:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764796.221458:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221466:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221480:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764796.221483:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764796.221488:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 3/0,0 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221507:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5236bc lrc: 0/0,0 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764796.221524:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003b270800 reply state 0000000021d7dc12 transno 4294970642 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221537:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221543:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x135c53b8 (ffff96c2c7ea7500) 00010000:00010000:1.0:1775764796.221545:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764796.221549:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764796.221592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236b5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ca expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221608:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5236ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ca expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.221616:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7600) 00010000:00010000:1.0:1775764796.221618:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764796.221620:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5600, rc 0) 00000100:00100000:1.0:1775764796.221720:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:46903:x1862023076091648:12345-192.168.202.58@tcp:101:tee.0 Request processed in 4475us (5490us total) trans 4294970642 rc 0/0 00000100:00100000:1.0:1775764796.221729:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6470 00000100:00100000:0.0:1775764796.225861:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764796.227251:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076091776 00000100:00100000:2.0:1775764796.227269:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076091776 00000100:00100000:3.0:1775764796.227565:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1712 00000100:00100000:3.0:1775764796.227580:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:46903:x1862023076091776:12345-192.168.202.58@tcp:101:tee.0 00010000:00010000:3.0:1775764796.227605:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764796.227649:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52d1 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764796.227690:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1775764796.227717:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764796.227720:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764796.227731:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.227751:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764796.228220:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764796.228305:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:46903:x1862023076091776:12345-192.168.202.58@tcp:101:tee.0 Request processed in 729us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764796.228313:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1712 00000100:00100000:3.0:1775764796.231422:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00080000:1.0:1775764796.231556:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764796.231718:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076092032 00000100:00100000:2.0:1775764796.231729:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076092032 00000100:00100000:2.0:1775764796.231813:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1356 00000100:00100000:2.0:1775764796.231823:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:46903:x1862023076092032:12345-192.168.202.58@tcp:35:tee.0 00000100:00100000:2.0:1775764796.232308:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:46903:x1862023076092032:12345-192.168.202.58@tcp:35:tee.0 Request processed in 485us (898us total) trans 4294970643 rc 0/0 00000100:00100000:2.0:1775764796.232317:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1356 00000100:00100000:2.0:1775764796.273400:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.273506:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076092288 00000100:00100000:1.0:1775764796.273519:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076092288 00000100:00100000:1.0:1775764796.273583:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6471 00000100:00100000:1.0:1775764796.273593:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:46907:x1862023076092288:12345-192.168.202.58@tcp:36:chmod.0 00010000:00010000:1.0:1775764796.273691:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764796.273729:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5236ca lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ca expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.273752:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7600) 00010000:00010000:1.0:1775764796.273851:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764796.273886:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.273902:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.273913:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1775764796.274176:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764796.274181:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764796.274702:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764796.274714:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1775764796.274913:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1775764796.275326:0:10681:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fc7b2e1c reply state 000000007c00a309 transno 4294970644 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.275343:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.275351:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:1.0:1775764796.275354:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1775764796.275358:0:10681:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764796.275493:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46907:x1862023076092288:12345-192.168.202.58@tcp:36:chmod.0 Request processed in 1898us (2102us total) trans 4294970644 rc 0/0 00000100:00100000:1.0:1775764796.275502:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6471 00000040:00080000:1.0:1775764796.276695:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764796.276701:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764796.276720:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 149 count 3 00000040:00080000:1.0:1775764796.276739:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764796.279259:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764796.279399:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076092416 00000100:00100000:0.0:1775764796.279411:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076092416 00000100:00100000:0.0:1775764796.279479:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6472 00000100:00100000:0.0:1775764796.279490:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46907:x1862023076092416:12345-192.168.202.58@tcp:101:chmod.0 00010000:00010000:0.0:1775764796.279519:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764796.279543:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed5236e6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52d8 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.279609:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed5236e6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d8 expref: 41 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.279626:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c000/0x6e98bd47ed5236e6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d8 expref: 41 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764796.279678:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:0.0:1775764796.279682:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1775764796.279688:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c000, rc 0) 00000100:00100000:0.0:1775764796.279803:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:46907:x1862023076092416:12345-192.168.202.58@tcp:101:chmod.0 Request processed in 314us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764796.279812:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6472 00000100:00100000:2.0:1775764796.283416:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.283498:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076092544 00000100:00100000:1.0:1775764796.283509:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076092544 00000100:00100000:1.0:1775764796.283569:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1713 00000100:00100000:1.0:1775764796.283579:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076092544:12345-192.168.202.58@tcp:2:chmod.0 00002000:00010000:1.0:1775764796.283807:0:8405:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1775764796.283812:0:8405:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1775764796.283814:0:8405:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1775764796.283816:0:8405:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb ctime from disk: 0 -> 1775764795 00002000:00010000:1.0:1775764796.283819:0:8405:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1775764796.283879:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076092544:12345-192.168.202.58@tcp:2:chmod.0 Request processed in 302us (476us total) trans 4294967725 rc 0/0 00000100:00100000:1.0:1775764796.283887:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1713 00000100:00100000:1.0:1775764796.296581:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764796.296675:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076092672 00000100:00100000:2.0:1775764796.296687:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076092672 00000100:00100000:2.0:1775764796.296749:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6473 00000100:00100000:2.0:1775764796.296803:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:46908:x1862023076092672:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764796.296827:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764796.296854:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5236ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.296931:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.296948:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.296971:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.296982:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.296989:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.296994:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297070:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297098:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297105:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764796.297148:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x12:0x0]: returning size 53 00000004:00200000:2.0:1775764796.297152:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764796.297172:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297184:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297193:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297211:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297218:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297225:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297231:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764796.297235:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297243:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297265:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:2.0:1775764796.297268:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764796.297274:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297281:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5236f4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297296:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297302:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297308:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297313:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764796.297316:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297321:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297329:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x135c53b8 (ffff96c2c7ea7500) 00010000:00010000:2.0:1775764796.297331:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764796.297334:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 2/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297339:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5236fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297375:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5236ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52df expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297389:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52df expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764796.297396:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764796.297398:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764796.297400:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0600, rc 0) 00000100:00100000:2.0:1775764796.297473:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:46908:x1862023076092672:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 715us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764796.297480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6473 00000100:00100000:3.0:1775764796.303635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.303740:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076092800 00000100:00100000:1.0:1775764796.303752:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076092800 00000100:00100000:1.0:1775764796.303862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6474 00000100:00100000:1.0:1775764796.303872:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:46908:x1862023076092800:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764796.303895:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764796.303918:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52e6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.304006:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523710 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.304021:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523710 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.304034:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523710 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764796.304087:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 4096 00000004:00200000:1.0:1775764796.304091:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764796.304113:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523710 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.304140:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52e6 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.304157:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523710 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52e6 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764796.304166:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764796.304168:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764796.304172:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5000, rc 0) 00000100:00100000:1.0:1775764796.304242:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46908:x1862023076092800:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 372us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764796.304249:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6474 00000100:00100000:3.0:1775764796.309486:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764796.309683:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076093056 00000100:00100000:1.0:1775764796.309696:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076093056 00000100:00100000:1.0:1775764796.309759:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6475 00000100:00100000:1.0:1775764796.309795:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46908:x1862023076093056:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:1.0:1775764796.310014:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].149, 136 off28248 00000100:00100000:1.0:1775764796.310104:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46908:x1862023076093056:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 335us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764796.310111:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6475 00000100:00100000:2.0:1775764797.235355:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099799936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764797.235440:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764797.238956:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099799936 00000100:00100000:1.0:1775764797.238981:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099799936 00000100:00100000:1.0:1775764797.239038:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1775764797.239047:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099799936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764797.239075:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41332928 pending 0 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764797.239169:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099799936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764797.239176:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1775764797.239204:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099800064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764797.239241:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1775764797.239289:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764797.239300:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099800064 00000100:00100000:1.0:1775764797.239304:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099800064 00000100:00100000:1.0:1775764797.239330:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1775764797.239336:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099800064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764797.239346:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41332928 pending 0 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764797.239373:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099800064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764797.239379:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00080000:1.0:1775764797.239394:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764797.239425:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099800064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764797.239459:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099799936:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1775764797.298013:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764797.298023:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764797.298055:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 150 count 4 00000040:00080000:1.0:1775764797.298065:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764797.298311:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099800192:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764797.298463:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c56553c0 going to sleep for 11 seconds 00000001:00080000:3.0:1775764797.300822:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970644 is committed 00000001:00080000:3.0:1775764797.300843:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970639 is committed 00000020:00080000:3.0:1775764797.300866:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 123 batchid updated 00000020:00080000:3.0:1775764797.300883:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 123 00000020:00080000:3.0:1775764797.300891:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 123 00010000:00010000:1.0:1775764797.300951:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.300964:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.300972:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.300978:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764797.300983:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.300990:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301342:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93e911e6 (ffff96c1c2a03200) 00010000:00010000:1.0:1775764797.301346:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764797.301352:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301358:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52365a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x93e911e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301380:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301387:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301393:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301413:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764797.301416:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301421:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301527:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764797.301529:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764797.301533:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301538:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed523661 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301558:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301564:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301570:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301575:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764797.301578:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301583:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301601:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764797.301603:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1775764797.301606:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301612:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523692 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301625:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301631:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301637:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301651:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764797.301654:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301660:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301667:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x135c53b8 (ffff96c2c7ea7500) 00010000:00010000:1.0:1775764797.301669:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764797.301671:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301677:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed5236c3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301700:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301705:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301710:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301715:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764797.301717:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301723:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301731:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:1.0:1775764797.301733:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1775764797.301736:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.301740:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed5236df lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.312449:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764797.318211:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764797.318220:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1775764797.318961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000040:00080000:1.0:1775764797.319077:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764797.319087:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764797.319452:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099800192:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764797.325024:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076093184 00000100:00100000:2.0:1775764797.325040:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076093184 00000100:00100000:2.0:1775764797.325200:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6476 00000100:00100000:2.0:1775764797.325211:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+46:46918:x1862023076093184:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764797.325245:0:14288:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000405:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1775764797.325367:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+46:46918:x1862023076093184:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 158us (6412us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764797.325374:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6476 00000100:00100000:3.0:1775764797.329822:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764797.329955:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076093440 00000100:00100000:0.0:1775764797.329968:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076093440 00000100:00100000:0.0:1775764797.330034:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6477 00000100:00100000:0.0:1775764797.330044:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+46:46918:x1862023076093440:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764797.330064:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764797.330086:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523717 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52ed expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.330208:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.330225:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.330238:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764797.330251:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x12:0x0]: returning size 53 00010000:00010000:0.0:1775764797.330365:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523717 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.330396:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.330405:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:0.0:1775764797.330408:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764797.330412:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ce00, rc 0) 00000100:00100000:0.0:1775764797.330463:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:46918:x1862023076093440:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 421us (650us total) trans 4294970645 rc 0/0 00000100:00100000:0.0:1775764797.330470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6477 00000100:00100000:3.0:1775764797.336263:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764797.337900:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076093568 00000100:00100000:2.0:1775764797.337914:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076093568 00000100:00100000:2.0:1775764797.338000:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1714 00000100:00100000:2.0:1775764797.338018:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+5:2410:x1862023076093568:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1775764797.338065:0:24969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.338086:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.338106:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1775764797.338109:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1775764797.338112:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.338149:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.338163:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 7 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764797.338179:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099800320:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764797.338266:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d6be8000 going to sleep for 11 seconds 00000100:00080000:2.0:1775764797.338284:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764797.347962:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764797.347994:0:8408:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076093696 00000100:00100000:3.0:1775764797.348004:0:8408:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076093696 00002000:00100000:3.0:1775764797.348052:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x55:0x0] (0->52) req@ffff96c1c7445f80 x1862023076093696/t0(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:278/0 lens 544/0 e 0 to 0 dl 1775764808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764797.348063:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c7445f80 with x1862023076093696 ext(0->52) 00010000:00010000:3.0:1775764797.348072:0:8408:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 8 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.348088:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 8 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764797.348096:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c7445f80 00000100:00100000:3.0:1775764797.348131:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 32 00000100:00100000:3.0:1775764797.348140:0:8408:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076093696:12345-192.168.202.58@tcp:4:tee.0 00000100:00100000:3.0:1775764797.348570:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099800320:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764797.348595:0:24969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764797.352358:0:8408:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076093696:12345-192.168.202.58@tcp:4:tee.0 Request processed in 4206us (4394us total) trans 4294967726 rc 0/0 00000100:00100000:3.0:1775764797.352373:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 32 00002000:00100000:3.0:1775764797.352386:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x55:0x0] (0->52) req@ffff96c1c7445f80 x1862023076093696/t4294967726(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:278/0 lens 544/448 e 0 to 0 dl 1775764808 ref 1 fl Complete:H/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764797.352396:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c7445f80 with x1862023076093696 ext(0->52) 00010000:00010000:3.0:1775764797.352416:0:8408:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 10 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.352435:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 10 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764797.352444:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c7445f80 00000100:00100000:0.0:1775764797.368580:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764797.372037:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076093824 00000100:00100000:2.0:1775764797.372051:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076093824 00010000:00010000:2.0:1775764797.372107:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 10 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764797.372150:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1400 00000100:00100000:2.0:1775764797.372167:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076093824:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764797.372183:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1775764797.372200:0:6505:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb size from disk: 0 -> 53 00002000:00010000:2.0:1775764797.372203:0:6505:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb mtime from disk: 0 -> 1775764795 00002000:00010000:2.0:1775764797.372206:0:6505:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1775764797.372212:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 10 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372226:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 10 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372249:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098db8d46/0x6e98bd47ed5236d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52d1 expref: 10 pid: 15167 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372262:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764797.372264:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764797.372269:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372280:0:6505:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372308:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764797.372366:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076093824:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 200us (3797us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764797.372374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1400 00010000:00010000:2.0:1775764797.372405:0:24969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372419:0:24969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372438:0:24969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372445:0:24969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372453:0:24969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372460:0:24969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764797.372465:0:24969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372473:0:24969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372485:0:24969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.372492:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008612845f/0x6e98bd47ed52372c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764797.372550:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+5:2410:x1862023076093568:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 34534us (36299us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764797.372558:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1714 00000040:00080000:2.0:1775764797.378946:0:30170:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764797.378956:0:30170:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764797.378993:0:30170:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 150 count 4 00000040:00080000:2.0:1775764797.378999:0:30170:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764797.380745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764797.380896:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094080 00000100:00100000:3.0:1775764797.380908:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094080 00000100:00100000:3.0:1775764797.380963:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6478 00000100:00100000:3.0:1775764797.380973:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:46918:x1862023076094080:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764797.381082:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:46918:x1862023076094080:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764797.381306:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6478 00000100:00100000:3.0:1775764797.386997:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764797.387078:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094208 00000100:00100000:1.0:1775764797.387088:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094208 00000100:00100000:1.0:1775764797.387154:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1715 00000100:00100000:1.0:1775764797.387165:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076094208:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764797.387183:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764797.387205:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52f4 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764797.387233:0:8402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x55:0x0] initial LVB size: 53, mtime: 0x69d8053b, atime: 0x0, ctime: 0x69d8053b, blocks: 0x8 00010000:00010000:1.0:1775764797.387256:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764797.387259:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764797.387268:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.387286:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764797.387301:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5a00, rc 0) 00000100:00100000:1.0:1775764797.387358:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076094208:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 195us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764797.387365:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1715 00000100:00100000:3.0:1775764797.393049:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764797.393449:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094464 00000100:00100000:0.0:1775764797.393460:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094464 00000100:00100000:0.0:1775764797.393519:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6479 00000100:00100000:0.0:1775764797.393529:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+48:46918:x1862023076094464:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764797.393639:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+48:46918:x1862023076094464:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 111us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764797.393657:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6479 00000100:00100000:1.0:1775764797.404523:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764797.404603:0:25201:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094592 00000100:00100000:2.0:1775764797.404614:0:25201:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094592 00002000:00100000:2.0:1775764797.404674:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x55:0x0] (0->4095) req@ffff96c1c739a680 x1862023076094592/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:278/0 lens 488/0 e 0 to 0 dl 1775764808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764797.404686:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c739a680 with x1862023076094592 ext(0->4095) 00002000:00010000:2.0:1775764797.404692:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c739a680 00000100:00100000:2.0:1775764797.404727:0:25201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 432 00000100:00100000:2.0:1775764797.404737:0:25201:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076094592:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1775764797.404930:0:25201:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076094592:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 194us (412us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1775764797.404938:0:25201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 432 00002000:00100000:2.0:1775764797.404958:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x55:0x0] (0->4095) req@ffff96c1c739a680 x1862023076094592/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:278/0 lens 488/4536 e 0 to 0 dl 1775764808 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764797.404966:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c739a680 with x1862023076094592 ext(0->4095) 00002000:00010000:2.0:1775764797.404969:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c739a680 00000100:00100000:3.0:1775764797.417600:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764797.429364:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094720 00000100:00100000:2.0:1775764797.429396:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094720 00000100:00100000:2.0:1775764797.429465:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6480 00000100:00100000:2.0:1775764797.429475:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:46918:x1862023076094720:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764797.429498:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764797.429519:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52373a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd52fb expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.429553:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.429568:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.429580:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.429699:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed52373a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 50 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.429718:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 49 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.429727:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764797.429730:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764797.429734:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1800, rc 0) 00000100:00100000:2.0:1775764797.430022:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+49:46918:x1862023076094720:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 547us (12432us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764797.430029:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6480 00000100:00100000:2.0:1775764797.455032:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764797.464334:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094848 00000100:00100000:3.0:1775764797.464351:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094848 00000100:00100000:1.0:1775764797.464592:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6481 00000100:00100000:1.0:1775764797.464603:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:46918:x1862023076094848:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764797.464638:0:6522:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000405:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764797.464802:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:46918:x1862023076094848:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 201us (9859us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764797.464822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6481 00000100:00100000:1.0:1775764797.467948:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764797.468534:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076094976 00000100:00100000:2.0:1775764797.468545:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076094976 00000100:00100000:2.0:1775764797.468603:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1716 00000100:00100000:2.0:1775764797.468614:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076094976:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1775764797.468670:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468687:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764797.468689:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764797.468694:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468708:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468732:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468740:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468747:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468754:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764797.468787:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468816:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468832:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764797.468839:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ec9f60/0x6e98bd47ed523748 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764797.468911:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076094976:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 300us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764797.468919:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1716 00000100:00100000:2.0:1775764797.474011:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764797.478611:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076095232 00000100:00100000:3.0:1775764797.478627:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076095232 00000100:00100000:3.0:1775764797.478713:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6482 00000100:00100000:3.0:1775764797.478724:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+49:46918:x1862023076095232:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764797.478827:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.478845:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 49 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.478865:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 4/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.478908:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 49 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764797.478920:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 49 pid: 14288 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764797.478936:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7445500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099800448:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764797.479049:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c635d540 going to sleep for 11 seconds 00000100:00100000:2.0:1775764797.488315:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764797.489557:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7445500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099800448:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764797.489587:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764797.490292:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076095360 00000100:00100000:0.0:1775764797.490301:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076095360 00010000:00010000:0.0:1775764797.490348:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 50 pid: 14288 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764797.490400:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1401 00000100:00100000:0.0:1775764797.490409:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+50:2411:x1862023076095360:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764797.490436:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764797.490443:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 50 pid: 14288 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490456:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 50 pid: 14288 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490478:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523741 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52fb expref: 50 pid: 14288 timeout: 1405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490494:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:0.0:1775764797.490500:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490511:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490519:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490546:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764797.490614:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:2411:x1862023076095360:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 204us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764797.490623:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1401 00010000:00010000:0.0:1775764797.490659:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490667:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490878:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490887:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490893:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490898:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764797.490903:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490910:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490918:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:0.0:1775764797.490921:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764797.490925:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 2/0,0 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764797.490931:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52374f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764797.491652:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+49:46918:x1862023076095232:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 12918us (17639us total) trans 4294970646 rc 0/0 00000100:00100000:0.0:1775764797.491664:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6482 00000040:00080000:1.0:1775764797.492585:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764797.492591:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764797.493112:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1775764797.493123:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764797.495572:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764797.497993:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076095616 00000100:00100000:3.0:1775764797.498008:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076095616 00000100:00100000:3.0:1775764797.498079:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1357 00000100:00100000:3.0:1775764797.498089:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df702450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:46918:x1862023076095616:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764797.498392:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df702450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:46918:x1862023076095616:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 303us (2827us total) trans 4294970647 rc 0/0 00000100:00100000:3.0:1775764797.498400:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1357 00000100:00100000:2.0:1775764798.258735:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1775764798.258765:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099800576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1775764798.258872:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.260671:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099800576 00000100:00100000:0.0:1775764798.260687:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099800576 00000100:00100000:0.0:1775764798.260853:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1775764798.260884:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d1202850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099800576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1775764798.260929:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:0.0:1775764798.261058:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d1202850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099800576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.261066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1775764798.262820:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099800576:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1775764798.322850:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764798.616488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616532:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616567:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616593:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616616:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616656:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616687:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616711:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616757:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764798.616818:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076095872 00000100:00100000:0.0:1775764798.616827:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076095872 00000100:00100000:0.0:1775764798.616885:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096000 00000100:00100000:0.0:1775764798.616888:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096000 00000100:00100000:0.0:1775764798.616906:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096512 00000100:00100000:0.0:1775764798.616909:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096512 00000100:00100000:0.0:1775764798.616923:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096384 00000100:00100000:0.0:1775764798.616925:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096384 00000100:00100000:0.0:1775764798.616941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1875 00000100:00100000:0.0:1775764798.616949:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:2410:x1862023076095872:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617025:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:2410:x1862023076095872:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 75us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617032:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1875 00000100:00100000:0.0:1775764798.617051:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1876 00000100:00100000:0.0:1775764798.617071:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076096000:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617098:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076096000:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1876 00000100:00100000:0.0:1775764798.617132:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1877 00000100:00100000:0.0:1775764798.617138:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076096512:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617160:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076096512:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1877 00000100:00100000:0.0:1775764798.617557:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1878 00000100:00100000:0.0:1775764798.617568:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:2410:x1862023076096384:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617599:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:2410:x1862023076096384:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 34us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617606:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1878 00000100:00100000:0.0:1775764798.617647:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096256 00000100:00100000:0.0:1775764798.617652:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096256 00000100:00100000:0.0:1775764798.617687:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096768 00000100:00100000:0.0:1775764798.617690:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096768 00000100:00100000:0.0:1775764798.617711:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096128 00000100:00100000:0.0:1775764798.617714:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096128 00000100:00100000:0.0:1775764798.617723:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076096640 00000100:00100000:0.0:1775764798.617726:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076096640 00000100:00100000:0.0:1775764798.617738:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1363 00000100:00100000:0.0:1775764798.617743:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076096256:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617791:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076096256:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617805:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1363 00000100:00100000:0.0:1775764798.617818:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1364 00000100:00100000:0.0:1775764798.617824:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076096768:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617848:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076096768:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617854:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1364 00000100:00100000:0.0:1775764798.617865:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1365 00000100:00100000:0.0:1775764798.617870:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076096128:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617889:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076096128:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 19us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.617894:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1365 00000100:00100000:0.0:1775764798.617903:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1366 00000100:00100000:0.0:1775764798.617908:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076096640:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764798.617925:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076096640:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 18us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.618112:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076095744 00000100:00100000:3.0:1775764798.618119:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076095744 00000100:00100000:3.0:1775764798.618161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 959 00000100:00100000:3.0:1775764798.618167:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d2537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076095744:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764798.618207:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d2537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076095744:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 41us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.618213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 959 00000100:00080000:3.0:1775764798.618269:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764798.618274:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764798.618277:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764798.618279:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764798.618916:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1366 00000100:00100000:0.0:1775764798.770321:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099800832:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770389:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.770445:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099801344:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770481:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.770498:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099801856:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770517:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.770561:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775764798.770568:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099800704:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770596:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.770616:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099801216:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770646:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.770661:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099801728:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770693:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764798.770726:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099800832 00000100:00100000:0.0:1775764798.770734:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099800832 00000100:00100000:0.0:1775764798.770801:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801344 00000100:00100000:0.0:1775764798.770804:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801344 00000100:00100000:0.0:1775764798.770832:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801856 00000100:00100000:0.0:1775764798.770835:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801856 00000100:00100000:0.0:1775764798.770848:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801216 00000100:00100000:0.0:1775764798.770851:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801216 00000100:00100000:0.0:1775764798.770862:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801728 00000100:00100000:0.0:1775764798.770864:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801728 00000100:00100000:0.0:1775764798.770878:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:0.0:1775764798.770886:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099800832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770942:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099800832:12345-0@lo:400:kworker.0 Request processed in 56us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.770949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:0.0:1775764798.770966:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1775764798.770972:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099801344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.770999:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099801344:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.771005:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1775764798.771016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1775764798.771029:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099801856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771057:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099801856:12345-0@lo:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.771063:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1775764798.771075:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:0.0:1775764798.771080:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099801216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771105:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099801216:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.771111:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:0.0:1775764798.771123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1775764798.771128:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099801728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771154:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099801728:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.771159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1775764798.771194:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099800704 00000100:00100000:0.0:1775764798.771198:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099800704 00000100:00100000:0.0:1775764798.771220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:0.0:1775764798.771226:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771252:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099800704:12345-0@lo:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.771259:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:0.0:1775764798.771306:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099800704:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771319:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099801216:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771327:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099801728:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771351:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099800832:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771359:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099801344:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.771366:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099801856:0@lo:400:kworker.0 00000100:00080000:3.0:1775764798.771824:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764798.771831:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764798.771861:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099800960:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.771898:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764798.771924:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099801472:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.771946:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764798.771964:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c435bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099801984:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.771982:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764798.772000:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1775764798.772005:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099801088:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772026:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764798.772041:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099801600:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772058:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764798.772073:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099802112:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772090:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764798.772121:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801472 00000100:00100000:3.0:1775764798.772125:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801472 00000100:00100000:3.0:1775764798.772167:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801984 00000100:00100000:3.0:1775764798.772170:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801984 00000100:00100000:3.0:1775764798.772212:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801600 00000100:00100000:3.0:1775764798.772215:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801600 00000100:00100000:3.0:1775764798.772225:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099802112 00000100:00100000:3.0:1775764798.772227:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099802112 00000100:00100000:3.0:1775764798.772240:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1775764798.772246:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099801472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772289:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099801472:12345-0@lo:400:kworker.0 Request processed in 43us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.772296:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1775764798.772310:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1775764798.772316:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099801984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772341:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099801984:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.772347:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1775764798.772358:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1775764798.772364:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099801600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772389:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099801600:12345-0@lo:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.772395:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1775764798.772405:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1775764798.772410:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099802112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772435:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099802112:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.772440:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00080000:3.0:1775764798.772487:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764798.772524:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099801600:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772534:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099802112:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772542:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099801472:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772550:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c435bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099801984:0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772576:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099801088 00000100:00100000:3.0:1775764798.772580:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099801088 00000100:00100000:3.0:1775764798.772604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:3.0:1775764798.772610:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099801088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764798.772662:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099801088:12345-0@lo:400:kworker.0 Request processed in 52us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764798.772667:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:3.0:1775764798.773138:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099801088:0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.773862:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099800960 00000100:00100000:0.0:1775764798.773871:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099800960 00000100:00100000:0.0:1775764798.773920:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1775764798.773928:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099800960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764798.774000:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099800960:12345-0@lo:400:kworker.0 Request processed in 72us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764798.774007:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1775764798.774043:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099800960:0@lo:400:kworker.0 00000100:00100000:0.0:1775764799.282018:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099802240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764799.282096:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764799.282222:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099802240 00000100:00100000:1.0:1775764799.282230:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099802240 00000100:00100000:1.0:1775764799.282288:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1775764799.282298:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099802240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764799.282332:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:1.0:1775764799.282380:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099802240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764799.282387:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1775764799.282528:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099802368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764799.282554:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764799.282641:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099802368 00000100:00100000:2.0:1775764799.282646:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099802368 00000100:00100000:2.0:1775764799.282678:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1775764799.282686:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099802368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764799.282699:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:2.0:1775764799.282747:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099802368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764799.282754:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1775764799.282821:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099802368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764799.283079:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099802240:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1775764799.288846:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967726 is committed 00010000:00010000:2.0:1775764799.350028:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764799.674096:0:30222:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764799.674106:0:30222:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764799.674142:0:30222:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 150 count 4 00000040:00080000:3.0:1775764799.674150:0:30222:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764799.783610:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764799.783915:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097024 00000100:00100000:3.0:1775764799.783926:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097024 00000100:00100000:3.0:1775764799.783987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6483 00000100:00100000:3.0:1775764799.783997:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:46929:x1862023076097024:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764799.784020:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764799.784043:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523756 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5302 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764799.784159:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52375d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764799.784188:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52375d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764799.784200:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52375d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764799.784212:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x12:0x0]: returning size 53 00010000:00010000:3.0:1775764799.784520:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523756 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5302 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764799.784543:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52375d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5302 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764799.784553:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:3.0:1775764799.784556:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764799.784560:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9000, rc 0) 00000100:00100000:3.0:1775764799.785610:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46929:x1862023076097024:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1607us (2002us total) trans 4294970648 rc 0/0 00000100:00100000:3.0:1775764799.785813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6483 00000100:00100000:3.0:1775764799.792036:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764799.792112:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764799.792178:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097280 00000100:00100000:1.0:1775764799.792189:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097280 00000100:00100000:1.0:1775764799.792251:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6484 00000100:00100000:1.0:1775764799.792261:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46929:x1862023076097280:12345-192.168.202.58@tcp:54:lfs.0 00010000:00010000:1.0:1775764799.792344:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792363:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792375:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792441:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792449:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792456:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792462:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764799.792467:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792474:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792488:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:1.0:1775764799.792491:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1775764799.792496:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.792500:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed52376b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764799.792574:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46929:x1862023076097280:12345-192.168.202.58@tcp:54:lfs.0 Request processed in 314us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764799.792581:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6484 00000100:00100000:0.0:1775764799.793079:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097152 00000100:00100000:0.0:1775764799.793085:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097152 00000100:00100000:0.0:1775764799.793135:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 745 00000100:00100000:0.0:1775764799.793143:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:2410:x1862023076097152:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764799.793155:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764799.793172:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52375d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5302 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764799.793185:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:0.0:1775764799.793197:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764799.793237:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:2410:x1862023076097152:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 94us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764799.793244:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 745 00000100:00100000:3.0:1775764799.811216:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764799.811258:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097536 00000100:00100000:3.0:1775764799.811271:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097536 00000100:00100000:3.0:1775764799.811340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1358 00000100:00100000:3.0:1775764799.811353:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:46929:x1862023076097536:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:3.0:1775764799.811655:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46929:x1862023076097536:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 305us (453us total) trans 4294970649 rc 0/0 00000100:00100000:3.0:1775764799.811679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1358 00000100:00100000:1.0:1775764799.946100:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764799.946184:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097664 00000100:00100000:3.0:1775764799.946194:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097664 00000100:00100000:3.0:1775764799.946257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1359 00000100:00100000:3.0:1775764799.946267:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076097664:12345-192.168.202.58@tcp:49:tee.500 00000100:00100000:3.0:1775764799.946408:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076097664:12345-192.168.202.58@tcp:49:tee.500 Request processed in 142us (318us total) trans 0 rc -61/-61 00000100:00100000:3.0:1775764799.946415:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1359 00000100:00100000:3.0:1775764799.949200:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764799.949278:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097792 00000100:00100000:1.0:1775764799.949288:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097792 00000100:00100000:1.0:1775764799.949365:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1360 00000100:00100000:1.0:1775764799.949374:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076097792:12345-192.168.202.58@tcp:49:tee.500 00000100:00100000:1.0:1775764799.949510:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076097792:12345-192.168.202.58@tcp:49:tee.500 Request processed in 138us (320us total) trans 0 rc -61/-61 00000100:00100000:1.0:1775764799.949519:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1360 00000100:00100000:3.0:1775764799.955145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764799.955225:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076097920 00000100:00100000:1.0:1775764799.955236:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076097920 00000100:00100000:1.0:1775764799.955291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1361 00000100:00100000:1.0:1775764799.955308:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076097920:12345-192.168.202.58@tcp:49:tee.500 00000100:00100000:1.0:1775764799.955465:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076097920:12345-192.168.202.58@tcp:49:tee.500 Request processed in 158us (331us total) trans 0 rc -61/-61 00000100:00100000:1.0:1775764799.955473:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1361 00000100:00100000:1.0:1775764799.966128:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764799.966170:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076098176 00000100:00100000:1.0:1775764799.966180:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076098176 00000100:00100000:1.0:1775764799.966251:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6485 00000100:00100000:1.0:1775764799.966262:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:46935:x1862023076098176:12345-192.168.202.58@tcp:101:tee.500 00010000:00010000:1.0:1775764799.966282:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764799.966286:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1775764799.966314:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523710 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52e6 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.966330:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:1.0:1775764799.966342:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764799.966354:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523772 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5309 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.966482:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.966497:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.966508:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764799.966519:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x12:0x0]: returning size 53 00010000:00010000:1.0:1775764799.966676:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4e00/0x6e98bd47ed523772 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 38 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.966689:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 37 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.966696:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:1.0:1775764799.966698:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764799.966700:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4c00, rc 0) 00000100:00100000:1.0:1775764799.967397:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:46935:x1862023076098176:12345-192.168.202.58@tcp:101:tee.500 Request processed in 1133us (1274us total) trans 4294970650 rc 0/0 00000100:00100000:1.0:1775764799.967406:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6485 00000100:00100000:2.0:1775764799.972807:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764799.972842:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076098304 00000100:00100000:2.0:1775764799.972853:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076098304 00000100:00100000:2.0:1775764799.972908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6486 00000100:00100000:2.0:1775764799.972930:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:46935:x1862023076098304:12345-192.168.202.58@tcp:101:tee.500 00010000:00010000:2.0:1775764799.972959:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764799.972984:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523787 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5310 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.973023:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed52378e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.973038:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed52378e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.973051:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed52378e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.973170:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523787 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5310 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.973189:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0c00/0x6e98bd47ed52378e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5310 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.973210:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764799.973213:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764799.973217:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0c00, rc 0) 00000100:00100000:2.0:1775764799.973278:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:46935:x1862023076098304:12345-192.168.202.58@tcp:101:tee.500 Request processed in 361us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764799.973286:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6486 00000100:00100000:2.0:1775764799.977949:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764799.977991:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764799.978024:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076098688 00000100:00100000:2.0:1775764799.978036:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076098688 00000100:00100000:2.0:1775764799.978089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6487 00000100:00100000:2.0:1775764799.978098:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:46935:x1862023076098688:12345-192.168.202.58@tcp:36:tee.500 00010000:00010000:2.0:1775764799.978163:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764799.978196:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523702 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52df expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978221:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764799.978226:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764799.978411:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978424:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978434:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 38 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978453:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 5/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978489:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 38 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978502:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 38 pid: 10681 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764799.978518:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099802496:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764799.978610:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.978633:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 49 pid: 6523 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764799.978642:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099802624:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764799.978667:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1cdfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1775764799.979640:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076098432 00000100:00100000:1.0:1775764799.979651:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076098432 00010000:00010000:1.0:1775764799.979691:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 39 pid: 10681 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764799.979726:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1402 00000100:00100000:1.0:1775764799.979746:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:2410:x1862023076098432:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764799.979760:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764799.979766:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 39 pid: 10681 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.979795:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 39 pid: 10681 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.979814:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:1.0:1775764799.979819:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764799.979827:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764799.979869:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:2410:x1862023076098432:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 125us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764799.979876:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1402 00010000:00010000:2.0:1775764799.995520:0:6522:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.58@tcp) returned -22 from blocking AST (req@00000000b8fa4691 x1862023099802496) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 38 pid: 10681 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.995545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523779 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5309 expref: 38 pid: 10681 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764799.995563:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099802496:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764799.995593:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099802624:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764799.995614:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764799.995630:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764799.995643:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764800.010866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764800.011826:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076098816 00000100:00100000:2.0:1775764800.011840:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076098816 00010000:00010000:2.0:1775764800.011914:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 50 pid: 6523 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764800.011960:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1403 00000100:00100000:2.0:1775764800.011971:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:2410:x1862023076098816:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764800.011989:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764800.011997:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 50 pid: 6523 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.012012:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 50 pid: 6523 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.012042:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52371e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52ed expref: 50 pid: 6523 timeout: 1407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.012065:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764800.012072:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.012101:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.012108:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.012147:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764800.012171:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.012179:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764800.012216:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:2410:x1862023076098816:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 247us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764800.012223:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1403 00000001:00080000:1.0:1775764800.012284:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970651 00000004:00010000:1.0:1775764800.012346:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007ba7dd9e reply state 00000000413287aa transno 4294970652 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.012360:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.012366:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:1.0:1775764800.012375:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764800.012378:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1775764800.012454:0:6522:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970652 00000100:00100000:1.0:1775764800.012549:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46935:x1862023076098688:12345-192.168.202.58@tcp:36:tee.500 Request processed in 34451us (34556us total) trans 4294970653 rc 0/0 00000100:00100000:1.0:1775764800.012557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6487 00000020:00080000:1.0:1775764800.012561:0:6522:0:(tgt_main.c:783:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:3.0:1775764800.012955:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764800.015113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764800.023836:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076098944 00000100:00100000:1.0:1775764800.023854:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076098944 00000100:00100000:1.0:1775764800.023939:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1717 00000100:00100000:1.0:1775764800.023949:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:46935:x1862023076098944:12345-192.168.202.58@tcp:101:tee.500 00010000:00010000:1.0:1775764800.023969:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764800.023987:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52379c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5317 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.024021:0:15167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 5 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.024030:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764800.024032:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764800.024036:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52379c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5317 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.024074:0:15167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 5 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764800.024087:0:15167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 5 pid: 8402 timeout: 1407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764800.024120:0:15167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15167:1862023099802752:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764800.024220:0:15167:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c14c9540 going to sleep for 11 seconds 00000100:00080000:1.0:1775764800.024250:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764800.044012:0:15167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15167:1862023099802752:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764800.044054:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52379c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5317 expref: 7 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.044081:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4e00, rc 0) 00000100:00100000:2.0:1775764800.044151:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:46935:x1862023076098944:12345-192.168.202.58@tcp:101:tee.500 Request processed in 20202us (29045us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764800.044162:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1717 00000100:00100000:2.0:1775764800.058986:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764800.061015:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076099072 00000100:00100000:3.0:1775764800.061025:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076099072 00010000:00010000:3.0:1775764800.061077:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 6 pid: 8402 timeout: 1407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764800.061158:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1404 00000100:00100000:3.0:1775764800.061166:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076099072:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764800.061180:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764800.061185:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 6 pid: 8402 timeout: 1407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.061197:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 6 pid: 8402 timeout: 1407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.061227:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070279e0c/0x6e98bd47ed523733 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52f4 expref: 6 pid: 8402 timeout: 1407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.061240:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764800.061242:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764800.061249:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52379c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5317 expref: 6 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.061257:0:6507:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52379c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5317 expref: 6 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.061298:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fef542bb/0x6e98bd47ed52379c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5317 expref: 6 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764800.061311:0:6507:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1862023099802880:192.168.202.58@tcp:105: 00000100:00100000:3.0:1775764800.061398:0:6507:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c49c2b40 going to sleep for 11 seconds 00000100:00080000:3.0:1775764800.061413:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764800.071056:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764800.071325:0:6507:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1862023099802880:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764800.071350:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764800.072807:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+5:2410:x1862023076099072:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 11633us (13827us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764800.072820:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1404 00000100:00100000:1.0:1775764800.082346:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076099200 00000100:00100000:1.0:1775764800.082358:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076099200 00002000:00010000:1.0:1775764800.082400:0:8409:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/85 (0->18446744073709551615) 00002000:00100000:1.0:1775764800.082405:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4359880 with x1862023076099200 ext(0->18446744073709551615) 00002000:00010000:1.0:1775764800.082419:0:8409:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c4359880. 00000100:00100000:1.0:1775764800.082692:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 433 00000100:00100000:1.0:1775764800.082704:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076099200:12345-192.168.202.58@tcp:10:tee.500 00002000:00010000:1.0:1775764800.083039:0:8409:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb size from disk: 53 -> 0 00002000:00010000:1.0:1775764800.083043:0:8409:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb mtime from disk: 1775764795 -> 1775764799 00002000:00010000:1.0:1775764800.083045:0:8409:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1775764800.083047:0:8409:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb ctime from disk: 1775764795 -> 1775764799 00002000:00010000:1.0:1775764800.083050:0:8409:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x55:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1775764800.083114:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076099200:12345-192.168.202.58@tcp:10:tee.500 Request processed in 412us (12072us total) trans 4294967727 rc 0/0 00000100:00100000:1.0:1775764800.083121:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 433 00002000:00010000:1.0:1775764800.083124:0:8409:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/85 (0->18446744073709551615) 00002000:00100000:1.0:1775764800.083127:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4359880 with x1862023076099200 ext(0->18446744073709551615) 00002000:00010000:1.0:1775764800.083131:0:8409:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c4359880. 00000100:00100000:2.0:1775764800.091650:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764800.091918:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076099456 00000100:00100000:3.0:1775764800.091929:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076099456 00000100:00100000:3.0:1775764800.092039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1362 00000100:00100000:3.0:1775764800.092049:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df701850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:46935:x1862023076099456:12345-192.168.202.58@tcp:35:tee.500 00000100:00100000:3.0:1775764800.092344:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df701850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:46935:x1862023076099456:12345-192.168.202.58@tcp:35:tee.500 Request processed in 296us (701us total) trans 4294970654 rc 0/0 00000100:00100000:3.0:1775764800.092351:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1362 00000100:00080000:1.0:1775764800.092964:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764800.143241:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764800.143304:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076099712 00000100:00100000:3.0:1775764800.143316:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076099712 00000100:00100000:3.0:1775764800.143403:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6488 00000100:00100000:3.0:1775764800.143413:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:46938:x1862023076099712:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764800.143443:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764800.143463:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed5237a3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd531e expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143539:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 3/1,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143553:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143564:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143576:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143582:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143589:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143732:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5237b8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.143742:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5237b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144148:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5237b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764800.144160:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x12:0x0]: returning size 47 00010000:00010000:3.0:1775764800.144243:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144250:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144257:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144263:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764800.144267:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144274:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144287:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff96c1c2a03900) 00010000:00010000:3.0:1775764800.144298:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764800.144303:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144309:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144323:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144338:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144343:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144348:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764800.144351:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144357:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144365:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x135c53b8 (ffff96c1c2a04b00) 00010000:00010000:3.0:1775764800.144368:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764800.144371:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764800.144376:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237b1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x135c53b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.145136:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed5237a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd531e expref: 44 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.145155:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8400/0x6e98bd47ed5237b8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd531e expref: 43 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764800.145176:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:2.0:1775764800.145178:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764800.145181:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8400, rc 0) 00000100:00100000:2.0:1775764800.145253:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46938:x1862023076099712:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1841us (2020us total) trans 4294970655 rc 0/0 00000100:00100000:2.0:1775764800.145261:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6488 00000100:00100000:2.0:1775764800.155809:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764800.156441:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076099840 00000100:00100000:0.0:1775764800.156451:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076099840 00000100:00100000:0.0:1775764800.156517:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6489 00000100:00100000:0.0:1775764800.156526:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46938:x1862023076099840:12345-192.168.202.58@tcp:54:lfs.0 00010000:00010000:0.0:1775764800.156596:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156612:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156635:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156670:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156677:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156700:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156705:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764800.156709:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156715:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156728:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:0.0:1775764800.156730:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1775764800.156734:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764800.156739:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5237c6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764800.156859:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46938:x1862023076099840:12345-192.168.202.58@tcp:54:lfs.0 Request processed in 333us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764800.156867:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6489 00000100:00100000:3.0:1775764800.163202:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764800.163423:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100096 00000100:00100000:1.0:1775764800.163434:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100096 00000100:00100000:1.0:1775764800.163511:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1363 00000100:00100000:1.0:1775764800.163533:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:46938:x1862023076100096:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:1.0:1775764800.163817:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:46938:x1862023076100096:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 286us (624us total) trans 4294970656 rc 0/0 00000100:00100000:1.0:1775764800.163827:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1363 00010000:00010000:2.0:1775764800.370209:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764801.332172:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1775764801.332196:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099803008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764801.332264:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764801.332359:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803008 00000100:00100000:3.0:1775764801.332369:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803008 00000100:00100000:3.0:1775764801.332547:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1775764801.332557:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099803008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764801.332619:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444233216 avail 1297993728 00000100:00100000:3.0:1775764801.332673:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099803008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764801.332681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1775764801.332748:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099803008:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1775764801.394387:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764801.667077:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764801.667271:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764801.667346:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100352 00000100:00100000:3.0:1775764801.667359:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100352 00000100:00100000:3.0:1775764801.667425:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1718 00000100:00100000:3.0:1775764801.667435:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076100352:12345-192.168.202.58@tcp:16:kworker.0 00000100:00100000:1.0:1775764801.668092:0:16794:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100224 00000100:00100000:1.0:1775764801.668099:0:16794:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100224 00002000:00100000:1.0:1775764801.668234:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x55:0x0] (0->46) req@ffff96c2f7472450 x1862023076100224/t0(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:282/0 lens 536/0 e 0 to 0 dl 1775764812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1775764801.668245:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2f7472450 with x1862023076100224 ext(0->46) 00002000:00010000:1.0:1775764801.668251:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c2f7472450 00000100:00100000:1.0:1775764801.668314:0:16794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 434 00000100:00100000:1.0:1775764801.668323:0:16794:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076100224:12345-192.168.202.58@tcp:4:tee.500 00000100:00100000:1.0:1775764801.669320:0:16794:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2411:x1862023076100224:12345-192.168.202.58@tcp:4:tee.500 Request processed in 991us (2244us total) trans 4294967728 rc 0/0 00000100:00100000:1.0:1775764801.669331:0:16794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 434 00002000:00100000:1.0:1775764801.669342:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x55:0x0] (0->46) req@ffff96c2f7472450 x1862023076100224/t4294967728(0) o4->11b6e21a-ce9d-4bf4-8cc8-5d154b257af0@192.168.202.58@tcp:282/0 lens 536/448 e 0 to 0 dl 1775764812 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1775764801.669353:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2f7472450 with x1862023076100224 ext(0->46) 00002000:00010000:1.0:1775764801.669358:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c2f7472450 00000001:00080000:2.0:1775764801.671469:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967727 is committed 00000100:00100000:2.0:1775764801.671920:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076100352:12345-192.168.202.58@tcp:16:kworker.0 Request processed in 4481us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764801.671932:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1718 00000100:00100000:2.0:1775764802.356124:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764802.356150:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099803264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764802.356226:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764802.356313:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803264 00000100:00100000:2.0:1775764802.356323:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803264 00000100:00100000:2.0:1775764802.356391:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1775764802.356400:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099803264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1775764802.356425:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58179776 pending 28672 free 3916959744 avail 3685437440 00000100:00100000:2.0:1775764802.356472:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099803264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764802.356478:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00080000:2.0:1775764802.356499:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764802.356536:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099803264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764802.356825:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764802.356840:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099803136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764802.356871:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764802.357166:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803136 00000100:00100000:1.0:1775764802.357172:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803136 00000100:00100000:1.0:1775764802.357217:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1775764802.357223:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099803136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764802.357245:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58179776 pending 28672 free 3916959744 avail 3685437440 00000100:00100000:1.0:1775764802.357280:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099803136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764802.357286:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00080000:3.0:1775764802.357341:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764802.358854:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099803136:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1775764802.420095:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764803.379431:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099803392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1775764803.379599:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764803.381049:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803392 00000100:00100000:0.0:1775764803.381078:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803392 00000100:00100000:0.0:1775764803.381144:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1775764803.381154:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099803392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1775764803.381192:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000001:00080000:1.0:1775764803.389137:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970656 is committed 00000001:00080000:1.0:1775764803.389182:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970647 is committed 00010000:00010000:3.0:1775764803.391321:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764803.391341:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764803.391350:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764803.391358:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764803.391363:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764803.391371:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764803.391393:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x12:0x0].0x0 (ffff96c2c7ea7100) 00010000:00010000:3.0:1775764803.391397:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764803.391424:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764803.391431:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523795 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764803.396266:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099803392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15101us (16665us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764803.396280:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1775764803.405566:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099803392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1775764803.441991:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764803.730860:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764803.730898:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764803.730924:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764803.730942:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764803.730981:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764803.731012:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100480 00000100:00100000:3.0:1775764803.731025:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100480 00000100:00100000:3.0:1775764803.731090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 961 00000100:00100000:3.0:1775764803.731100:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d33cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076100480:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764803.731185:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d33cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076100480:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.731193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 961 00000100:00100000:3.0:1775764803.731231:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100608 00000100:00100000:3.0:1775764803.731235:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100608 00000100:00100000:3.0:1775764803.731394:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101120 00000100:00100000:3.0:1775764803.731397:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101120 00000100:00100000:3.0:1775764803.731419:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1885 00000100:00100000:3.0:1775764803.731425:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+46:2408:x1862023076100608:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764803.731628:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1886 00000100:00100000:1.0:1775764803.731638:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:2408:x1862023076101120:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764803.731673:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:2408:x1862023076101120:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 38us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764803.731679:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1886 00000100:00100000:3.0:1775764803.732152:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+46:2408:x1862023076100608:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 726us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.732160:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1885 00000100:00100000:3.0:1775764803.732182:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100864 00000100:00100000:3.0:1775764803.732197:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100864 00000100:00100000:3.0:1775764803.732268:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101376 00000100:00100000:3.0:1775764803.732272:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101376 00000100:00100000:1.0:1775764803.741346:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1371 00000100:00100000:1.0:1775764803.741376:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076100864:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764803.741493:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076100864:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 133us (10566us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764803.741502:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1371 00000100:00100000:1.0:1775764803.741533:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1372 00000100:00100000:1.0:1775764803.741542:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076101376:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764803.741571:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076101376:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 30us (10589us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764803.741577:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1372 00000100:00080000:0.0:1775764803.748838:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1775764803.748849:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764803.748936:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764803.749032:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764803.749087:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764803.749199:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100736 00000100:00100000:0.0:1775764803.749209:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100736 00000100:00100000:0.0:1775764803.749264:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101248 00000100:00100000:0.0:1775764803.749266:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101248 00000100:00100000:0.0:1775764803.749296:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1887 00000100:00100000:0.0:1775764803.749307:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076100736:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764803.749383:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076100736:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 77us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764803.749390:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1887 00000100:00100000:0.0:1775764803.749408:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1888 00000100:00100000:0.0:1775764803.749413:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2409:x1862023076101248:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764803.749435:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2409:x1862023076101248:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.749762:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764803.750154:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076100992 00000100:00100000:3.0:1775764803.750160:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076100992 00000100:00100000:3.0:1775764803.750194:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101504 00000100:00100000:3.0:1775764803.750197:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101504 00000100:00100000:3.0:1775764803.750213:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1373 00000100:00100000:3.0:1775764803.750221:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2409:x1862023076100992:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764803.750259:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2409:x1862023076100992:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 39us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.750265:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1373 00000100:00100000:3.0:1775764803.750278:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1374 00000100:00100000:3.0:1775764803.750284:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076101504:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764803.750306:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076101504:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.750311:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1374 00000100:00100000:0.0:1775764803.751834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1888 00000100:00080000:0.0:1775764803.751872:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764803.751890:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764803.891808:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099803648:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.891881:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.891944:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099804160:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.891965:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.891982:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099804672:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.891999:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.892021:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1775764803.892026:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099803520:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892070:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.892092:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099804032:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892110:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.892126:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099804544:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892146:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.892178:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803648 00000100:00100000:3.0:1775764803.892185:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803648 00000100:00100000:3.0:1775764803.892227:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804160 00000100:00100000:3.0:1775764803.892230:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804160 00000100:00100000:3.0:1775764803.892257:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804672 00000100:00100000:3.0:1775764803.892260:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804672 00000100:00100000:3.0:1775764803.892272:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804032 00000100:00100000:3.0:1775764803.892275:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804032 00000100:00100000:3.0:1775764803.892288:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804544 00000100:00100000:3.0:1775764803.892290:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804544 00000100:00100000:3.0:1775764803.892305:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1775764803.892312:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099803648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892361:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099803648:12345-0@lo:400:kworker.0 Request processed in 49us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.892368:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1775764803.892384:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1775764803.892389:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099804160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892414:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099804160:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.892420:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1775764803.892430:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:3.0:1775764803.892435:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099804672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892483:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099804672:12345-0@lo:400:kworker.0 Request processed in 47us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.892489:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:3.0:1775764803.892501:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:3.0:1775764803.892507:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099804032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892531:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099804032:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.892535:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:3.0:1775764803.892546:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1775764803.892552:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099804544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892577:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099804544:12345-0@lo:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.892594:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1775764803.892620:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803520 00000100:00100000:3.0:1775764803.892624:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803520 00000100:00100000:3.0:1775764803.892647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1775764803.892653:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099803520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892681:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099803520:12345-0@lo:400:kworker.0 Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.892687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1775764803.892738:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099803520:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892750:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099804032:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892758:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099804544:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892767:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099803648:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892808:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099804160:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.892817:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099804672:0@lo:400:kworker.0 00000100:00080000:0.0:1775764803.895082:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1775764803.895094:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764803.896813:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099803776:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.896890:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.896939:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099804288:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.896961:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.896980:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099804800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.896999:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.897021:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1775764803.897026:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099803904:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897044:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.897058:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099804416:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897074:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.897087:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099804928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897102:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764803.897129:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803776 00000100:00100000:3.0:1775764803.897136:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803776 00000100:00100000:3.0:1775764803.897173:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1775764803.897179:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897227:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099803776:12345-0@lo:400:kworker.0 Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.897233:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1775764803.897252:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804288 00000100:00100000:3.0:1775764803.897255:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804288 00000100:00100000:3.0:1775764803.897282:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804800 00000100:00100000:3.0:1775764803.897284:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804800 00000100:00100000:3.0:1775764803.897311:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804416 00000100:00100000:3.0:1775764803.897313:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804416 00000100:00100000:3.0:1775764803.897321:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099804928 00000100:00100000:3.0:1775764803.897323:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099804928 00000100:00100000:3.0:1775764803.897335:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1775764803.897340:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099804288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897368:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099804288:12345-0@lo:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.897372:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1775764803.897382:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1775764803.897387:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099804800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897412:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099804800:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.897418:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1775764803.897429:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1775764803.897434:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099804416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897470:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099804416:12345-0@lo:400:kworker.0 Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.897475:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1775764803.897486:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1775764803.897492:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099804928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897515:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099804928:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.897520:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1775764803.897569:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099804416:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897600:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099804928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897609:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099803776:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897617:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099804288:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897625:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099804800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897660:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099803904 00000100:00100000:3.0:1775764803.897663:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099803904 00000100:00100000:3.0:1775764803.897690:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1775764803.897695:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099803904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764803.897725:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099803904:12345-0@lo:400:kworker.0 Request processed in 30us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764803.897730:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1775764803.897756:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099803904:0@lo:400:kworker.0 00000100:00080000:0.0:1775764803.898686:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764804.402096:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1775764804.402131:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099805056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764804.402242:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764804.402244:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764804.402254:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c435b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099805184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764804.402285:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764804.402367:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805056 00000100:00100000:1.0:1775764804.402375:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805056 00000100:00100000:1.0:1775764804.402437:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805184 00000100:00100000:1.0:1775764804.402440:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805184 00000100:00100000:1.0:1775764804.402457:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1775764804.402465:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099805056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764804.402498:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:1.0:1775764804.402550:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099805056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764804.402558:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1775764804.402575:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1775764804.402592:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099805184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764804.402601:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:3.0:1775764804.402614:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099805056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764804.402626:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099805184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764804.402631:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:0.0:1775764804.402816:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c435b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099805184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1775764804.466259:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764805.506512:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764805.681986:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764805.681997:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764805.682121:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 150 count 2 00000040:00080000:1.0:1775764805.682129:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764806.074032:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764806.074190:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101632 00000100:00100000:0.0:1775764806.074201:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101632 00000100:00100000:0.0:1775764806.074280:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6490 00000100:00100000:0.0:1775764806.074291:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+46:46899:x1862023076101632:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764806.074414:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+46:46899:x1862023076101632:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 125us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764806.074423:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6490 00000100:00080000:2.0:1775764806.074797:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764806.077421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764806.080092:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101760 00000100:00100000:0.0:1775764806.080106:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101760 00000100:00100000:2.0:1775764806.082510:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6491 00000100:00100000:2.0:1775764806.082525:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:46899:x1862023076101760:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1775764806.082657:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:46899:x1862023076101760:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 136us (5246us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764806.082665:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6491 00000100:00080000:0.0:1775764806.083400:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764806.450307:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764806.450334:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099805312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764806.450414:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764806.450441:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805312 00000100:00100000:0.0:1775764806.450449:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805312 00000100:00100000:0.0:1775764806.450495:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1775764806.450504:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099805312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1775764806.450539:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444233216 avail 1297993728 00000100:00100000:0.0:1775764806.453333:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099805312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2819us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764806.453348:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1775764806.457121:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099805312:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764806.519285:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1775764806.964397:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967728 is committed 00000100:00100000:3.0:1775764807.479018:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764807.479045:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099805440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764807.479121:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764807.479911:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805440 00000100:00100000:1.0:1775764807.479919:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805440 00000100:00100000:1.0:1775764807.480000:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1775764807.480010:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099805440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764807.480041:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764807.480097:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099805440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764807.480105:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1775764807.480125:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1775764807.480142:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099805568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764807.480171:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1775764807.480199:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764807.480209:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805568 00000100:00100000:1.0:1775764807.480213:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805568 00000100:00100000:1.0:1775764807.480237:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1775764807.480243:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099805568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764807.480257:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764807.480299:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099805568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764807.480305:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00080000:1.0:1775764807.480320:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764807.480351:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099805568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764807.480385:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099805440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1775764807.539398:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764807.547982:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764807.547991:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764807.548641:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764807.548651:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1775764807.827749:0:30419:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 16:00:06 (1775764806) 00000100:00100000:1.0:1775764808.310947:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.311046:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076101888 00000100:00100000:3.0:1775764808.311060:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076101888 00000100:00080000:1.0:1775764808.311216:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764808.311821:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6492 00000100:00100000:3.0:1775764808.311850:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+46:47553:x1862023076101888:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764808.311880:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764808.311909:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5325 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.311984:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.311998:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.312012:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764808.312069:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1775764808.312073:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764808.312098:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.312125:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed5237cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.312144:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 47 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.312154:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764808.312173:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764808.312177:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764808.312418:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:47553:x1862023076101888:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 584us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.312426:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6492 00000100:00100000:1.0:1775764808.323400:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764808.323505:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076102144 00000100:00100000:2.0:1775764808.323515:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076102144 00000100:00100000:2.0:1775764808.323582:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6493 00000100:00100000:2.0:1775764808.323592:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+47:47554:x1862023076102144:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764808.323631:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764808.323651:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5237db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd532c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323725:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323740:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323751:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323808:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323814:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323821:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323916:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5237f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323924:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5237f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.323931:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5237f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764808.323940:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1775764808.324026:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324034:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324039:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324046:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324052:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764808.324057:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324065:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324079:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:2.0:1775764808.324082:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764808.324088:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324094:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5237e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324108:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324114:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324119:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324131:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764808.324133:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324139:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324147:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c1c7207400) 00010000:00010000:2.0:1775764808.324149:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764808.324152:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324158:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5237e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324425:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5237db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd532c expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324439:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5237f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd532c expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.324445:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764808.324448:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764808.324450:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0400, rc 0) 00000100:00100000:2.0:1775764808.324525:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+49:47554:x1862023076102144:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 934us (1135us total) trans 4294970657 rc 0/0 00000100:00100000:2.0:1775764808.324534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6493 00000100:00100000:2.0:1775764808.341740:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764808.341887:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.342053:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076102272 00000100:00100000:0.0:1775764808.342066:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076102272 00000100:00100000:0.0:1775764808.342153:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 746 00000100:00100000:0.0:1775764808.342166:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:2408:x1862023076102272:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764808.342184:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764808.342212:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5237f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd532c expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.342231:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764808.342237:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764808.342305:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:2408:x1862023076102272:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 142us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764808.342314:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 746 00000100:00100000:1.0:1775764808.342457:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076102528 00000100:00100000:1.0:1775764808.342461:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076102528 00000100:00100000:1.0:1775764808.342489:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1364 00000100:00100000:1.0:1775764808.342495:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:47554:x1862023076102528:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764808.342722:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:47554:x1862023076102528:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 227us (997us total) trans 4294970658 rc 0/0 00000100:00100000:1.0:1775764808.342730:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1364 00000100:00100000:1.0:1775764808.358834:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.358918:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076102656 00000100:00100000:3.0:1775764808.358928:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076102656 00000100:00100000:3.0:1775764808.358987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6494 00000100:00100000:3.0:1775764808.358995:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:47554:x1862023076102656:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1775764808.359089:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:47554:x1862023076102656:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.359096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6494 00000100:00100000:3.0:1775764808.362017:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764808.362456:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076102784 00000100:00100000:1.0:1775764808.362482:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076102784 00000100:00100000:1.0:1775764808.362569:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6495 00000100:00100000:1.0:1775764808.362580:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:47554:x1862023076102784:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764808.362688:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:47554:x1862023076102784:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 109us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764808.362696:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6495 00000100:00080000:2.0:1775764808.362813:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764808.372152:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.372209:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764808.372317:0:6531:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103040 00000100:00100000:2.0:1775764808.372327:0:6531:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103040 00000100:00100000:2.0:1775764808.372399:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 9 00000100:00100000:2.0:1775764808.372409:0:6531:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:47555:x1862023076103040:12345-192.168.202.58@tcp:700:mkdir.0 00000100:00100000:2.0:1775764808.372489:0:6531:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:47555:x1862023076103040:12345-192.168.202.58@tcp:700:mkdir.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.372497:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 9 00000100:00100000:3.0:1775764808.373249:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076102912 00000100:00100000:3.0:1775764808.374805:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076102912 00000100:00100000:3.0:1775764808.374892:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6496 00000100:00100000:3.0:1775764808.374902:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076102912:12345-192.168.202.58@tcp:41:mkdir.0 00000004:00000024:3.0:1775764808.374939:0:14288:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:3.0:1775764808.375008:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:2411:x1862023076102912:12345-192.168.202.58@tcp:41:mkdir.0 Request processed in 107us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.375016:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6496 00000100:00080000:1.0:1775764808.375616:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764808.380400:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.380587:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103296 00000100:00100000:3.0:1775764808.380598:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103296 00000100:00100000:3.0:1775764808.380664:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6497 00000100:00100000:3.0:1775764808.380674:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+5:47555:x1862023076103296:12345-192.168.202.58@tcp:36:mkdir.0 00000100:00100000:3.0:1775764808.380884:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099805696:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.380959:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.381020:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c2c0a240 going to sleep for 11 seconds 00000100:00100000:1.0:1775764808.381184:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805696 00000100:00100000:1.0:1775764808.381189:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805696 00000100:00100000:1.0:1775764808.381232:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1775764808.381247:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:24980:x1862023099805696:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1775764808.381351:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:24980:x1862023099805696:12345-0@lo:1000:mdt00_006.0 Request processed in 104us (390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1775764808.381361:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1775764808.381551:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099805696:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1775764808.381622:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.381633:0:24980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.381643:0:24980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764808.381658:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099805824:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1775764808.381691:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764808.381721:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c7e26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1775764808.382048:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099805824 00000100:00100000:1.0:1775764808.382054:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099805824 00000100:00100000:1.0:1775764808.382091:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1775764808.382099:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:24980:x1862023099805824:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1775764808.382111:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764808.382126:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e98bd47ed5237fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.382152:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 33 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.382161:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.382186:0:6527:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.382213:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 48 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.382227:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 48 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764808.382249:0:6527:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6527:1862023099805952:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764808.382325:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 33 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.382333:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 33 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764808.382342:0:6527:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6527:1862023099806080:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764808.382364:0:6527:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d6be8000 going to sleep for 11 seconds 00000100:00100000:1.0:1775764808.386533:0:6527:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6527:1862023099805952:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764808.386559:0:6527:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6527:1862023099806080:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764808.386601:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.386614:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764808.386633:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764808.386638:0:6527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.386648:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4800, rc 0) 00000100:00100000:1.0:1775764808.386715:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:24980:x1862023099805824:12345-0@lo:101:mdt00_006.0 Request processed in 4616us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764808.386724:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1775764808.386835:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099805824:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1775764808.386865:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.386876:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764808.389296:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.389338:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764808.389481:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103424 00000100:00100000:2.0:1775764808.389492:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103424 00010000:00010000:2.0:1775764808.389532:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 49 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764808.389579:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103552 00000100:00100000:2.0:1775764808.389582:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103552 00010000:00010000:2.0:1775764808.389617:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 34 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764808.389641:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1405 00000100:00100000:2.0:1775764808.389650:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:2410:x1862023076103424:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764808.389666:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764808.389673:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 49 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389686:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 49 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389710:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5237d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5325 expref: 49 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389727:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764808.389734:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389764:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764808.389873:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+48:2410:x1862023076103424:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 223us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.389881:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1405 00000100:00100000:2.0:1775764808.389900:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1406 00000100:00100000:2.0:1775764808.389907:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:2410:x1862023076103552:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764808.389916:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764808.389921:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 34 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389931:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 34 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389946:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed52366f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd52b5 expref: 34 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389956:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764808.389961:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389970:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.389979:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390024:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764808.390038:0:6506:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4358000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1862023099806208:0@lo:105: 00000100:00100000:2.0:1775764808.390076:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764808.390111:0:6506:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c7e26d80 going to sleep for 11 seconds 00000100:00100000:2.0:1775764808.390134:0:6503:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806208 00000100:00100000:2.0:1775764808.390137:0:6503:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806208 00000100:00100000:2.0:1775764808.390165:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1775764808.390171:0:6503:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6506:x1862023099806208:12345-0@lo:105: 00010000:00010000:2.0:1775764808.390182:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390193:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390202:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390209:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390217:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390227:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390267:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff96c1c1ba1200) 00000100:00100000:2.0:1775764808.390300:0:6503:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6506:x1862023099806208:12345-0@lo:105: Request processed in 129us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.390306:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1775764808.390344:0:6506:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4358000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1862023099806208:0@lo:105: 00010000:00010000:2.0:1775764808.390359:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764808.390377:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:2410:x1862023076103552:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 471us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.390384:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1406 00010000:00010000:2.0:1775764808.390402:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390411:0:24980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1775764808.390435:0:24980:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1775764808.390470:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390478:0:24980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390487:0:24980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764808.390503:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806336:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1775764808.390532:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764808.390570:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c9791900 going to sleep for 11 seconds 00000100:00100000:2.0:1775764808.390586:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806336 00000100:00100000:2.0:1775764808.390590:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806336 00000100:00100000:2.0:1775764808.390615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1775764808.390621:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:24980:x1862023099806336:12345-0@lo:101:mdt00_006.0 00010000:00010000:2.0:1775764808.390637:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764808.390652:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6e98bd47ed52380c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390671:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x6e98bd47ed52380c expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390683:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed52380c expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390690:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54506945 (ffff96c1c7207a00) 00010000:00010000:2.0:1775764808.390693:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764808.390695:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1800, rc 0) 00000100:00100000:2.0:1775764808.390725:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806336:12345-0@lo:101:mdt00_006.0 Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.390731:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1775764808.390759:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806336:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1775764808.390800:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.390809:0:24980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1775764808.390832:0:24980:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1775764808.390865:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806464:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1775764808.390892:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764808.390906:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c9791540 going to sleep for 11 seconds 00000100:00100000:3.0:1775764808.390991:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806464 00000100:00100000:3.0:1775764808.390995:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806464 00000100:00100000:3.0:1775764808.391027:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1775764808.391034:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806464:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391098:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806464:12345-0@lo:1000:mdt00_006.0 Request processed in 65us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.391105:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1775764808.391244:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806464:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391288:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806592:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391312:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.391326:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c2c0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1775764808.391337:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806592 00000100:00100000:3.0:1775764808.391340:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806592 00000100:00100000:3.0:1775764808.391357:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1775764808.391363:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806592:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391429:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806592:12345-0@lo:1000:mdt00_006.0 Request processed in 65us (115us total) trans 0 rc -2/-2 00000100:00100000:3.0:1775764808.391436:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1775764808.391460:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806592:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391575:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806720:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391600:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.391614:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c9791540 going to sleep for 11 seconds 00000100:00100000:3.0:1775764808.391625:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806720 00000100:00100000:3.0:1775764808.391628:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806720 00000100:00100000:3.0:1775764808.391652:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1775764808.391657:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806720:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391705:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806720:12345-0@lo:1000:mdt00_006.0 Request processed in 47us (104us total) trans 0 rc -2/-2 00000100:00100000:3.0:1775764808.391711:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1775764808.391734:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806720:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391817:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806848:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391840:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.391853:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c2c0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1775764808.391863:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806848 00000100:00100000:3.0:1775764808.391866:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806848 00000100:00100000:3.0:1775764808.391881:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1775764808.391887:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806848:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.391931:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806848:12345-0@lo:1000:mdt00_006.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.391936:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1775764808.391958:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806848:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.392001:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806976:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.392023:0:24980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.392035:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c9791540 going to sleep for 11 seconds 00000100:00100000:3.0:1775764808.392046:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099806976 00000100:00100000:3.0:1775764808.392048:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099806976 00000100:00100000:3.0:1775764808.392064:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1775764808.392069:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806976:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1775764808.392111:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:24980:x1862023099806976:12345-0@lo:1000:mdt00_006.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.392125:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1775764808.392149:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:24980:1862023099806976:0@lo:1000:mdt00_006.0 00000040:00080000:3.0:1775764808.392672:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].3, 992 off35720 00000040:00080000:3.0:1775764808.392734:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].3, 1144 off36176 00000004:00080000:3.0:1775764808.392741:0:24980:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96c1c2c0a3c0 with version 8 00000004:00080000:3.0:1775764808.392763:0:7449:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96c2d12a8f00 version 8 rpc_version 8 00000020:00100000:3.0:1775764808.392805:0:7449:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1775764808.392813:0:7449:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96c2fe1e3480 x1862023099807232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775764808.392828:0:7449:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7449:1862023099807232:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1775764808.392860:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.392877:0:7449:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c1359c00 going to sleep for 11 seconds 00000100:00100000:3.0:1775764808.392892:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099807232 00000100:00100000:3.0:1775764808.392897:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099807232 00000100:00100000:3.0:1775764808.392921:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1775764808.392927:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7449:x1862023099807232:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1775764808.393228:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7449:x1862023099807232:12345-0@lo:1000:osp_up0-1.0 Request processed in 300us (366us total) trans 4294970659 rc 0/0 00000100:00100000:3.0:1775764808.393236:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1775764808.393286:0:7449:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7449:1862023099807232:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1775764808.393365:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393379:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393393:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764808.393416:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e0b530a1 reply state 00000000d8c02603 transno 4294968425 ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393427:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393436:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:3.0:1775764808.393439:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764808.393443:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1775764808.393449:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000004:00080000:3.0:1775764808.393457:0:24980:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1775764808.393466:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393474:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393482:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393500:0:24980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1775764808.393504:0:24980:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1775764808.393509:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.393516:0:24980:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764808.393594:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:47555:x1862023076103296:12345-192.168.202.58@tcp:36:mkdir.0 Request processed in 12919us (13204us total) trans 4294968425 rc 0/0 00000100:00100000:3.0:1775764808.393607:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6497 00000100:00080000:0.0:1775764808.394287:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1775764808.395033:0:6508:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775764808.395044:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.395055:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc1824ea0) 00010000:00010000:0.0:1775764808.395063:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764808.395072:0:6508:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.395137:0:6508:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.395144:0:6508:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1775764808.395180:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.395187:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1200/0x6e98bd47ed5237fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x6e98bd47ed523805 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.395204:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764808.395205:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764808.395207:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764808.395215:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764808.395244:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099807360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1775764808.395514:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764808.395620:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099807360 00000100:00100000:1.0:1775764808.395631:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099807360 00000100:00100000:1.0:1775764808.395691:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1775764808.395701:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3663:x1862023099807360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1775764808.395714:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764808.395739:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523805 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x6e98bd47ed5237fe expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.395756:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764808.395797:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764808.395835:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3663:x1862023099807360:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764808.395853:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1775764808.395898:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099807360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1775764808.499673:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764808.499703:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099807488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764808.499835:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.500106:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099807488 00000100:00100000:3.0:1775764808.500115:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099807488 00000100:00100000:3.0:1775764808.500176:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1775764808.500185:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099807488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764808.500213:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:3.0:1775764808.500261:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099807488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.500269:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1775764808.500482:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099807488:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1775764808.562001:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764808.562011:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:1.0:1775764808.562110:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764808.564077:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764808.564110:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1775764808.754246:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764808.754261:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764808.754899:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1775764808.754914:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764808.834194:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.834249:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.834292:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.834333:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.834346:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103936 00000100:00100000:3.0:1775764808.834357:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103936 00000100:00100000:0.0:1775764808.834364:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.834386:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104448 00000100:00100000:0.0:1775764808.834402:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104448 00000100:00100000:3.0:1775764808.834413:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1895 00000100:00100000:3.0:1775764808.834427:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076103936:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764808.834509:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076103936:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.834569:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103680 00000100:00100000:2.0:1775764808.834573:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103680 00000100:00100000:0.0:1775764808.834603:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1896 00000100:00100000:2.0:1775764808.834603:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 963 00000100:00100000:2.0:1775764808.834610:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076103680:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764808.834611:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076104448:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764808.834640:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076104448:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.834645:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076103680:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764808.834647:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1896 00000100:00100000:2.0:1775764808.834652:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 963 00000100:00100000:1.0:1775764808.834744:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104192 00000100:00100000:1.0:1775764808.834755:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104192 00000100:00080000:0.0:1775764808.835451:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764808.838528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1895 00000100:00100000:1.0:1775764808.839383:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104704 00000100:00100000:1.0:1775764808.839395:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104704 00000100:00100000:2.0:1775764808.839493:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1379 00000100:00100000:2.0:1775764808.839505:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2409:x1862023076104192:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764808.839606:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2409:x1862023076104192:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 102us (5311us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.839614:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1379 00000100:00100000:2.0:1775764808.839642:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1380 00000100:00100000:2.0:1775764808.839650:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076104704:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764808.839677:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076104704:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 29us (5313us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.839699:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1380 00000100:00080000:0.0:1775764808.839741:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764808.848077:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.850171:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.850216:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.850570:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104064 00000100:00100000:3.0:1775764808.850583:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104064 00000100:00100000:3.0:1775764808.850666:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1381 00000100:00100000:3.0:1775764808.850677:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076104064:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764808.850758:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076104064:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 83us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764808.850765:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1381 00000100:00080000:1.0:1775764808.853529:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764808.861182:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.861229:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764808.861271:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076103808 00000100:00100000:2.0:1775764808.861282:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076103808 00000100:00100000:2.0:1775764808.861351:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104320 00000100:00100000:2.0:1775764808.861355:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104320 00000100:00100000:2.0:1775764808.861382:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1897 00000100:00100000:2.0:1775764808.861392:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+48:2408:x1862023076103808:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764808.861480:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+48:2408:x1862023076103808:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 89us (13413us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.861488:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1897 00000100:00100000:2.0:1775764808.861508:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1898 00000100:00100000:2.0:1775764808.861514:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:2408:x1862023076104320:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764808.861549:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:2408:x1862023076104320:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 34us (11332us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.861555:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1898 00000100:00100000:1.0:1775764808.862468:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104576 00000100:00100000:1.0:1775764808.862478:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104576 00000100:00100000:1.0:1775764808.862557:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1382 00000100:00100000:1.0:1775764808.862566:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076104576:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764808.862635:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076104576:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 70us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764808.862643:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1382 00000100:00080000:2.0:1775764808.863511:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764808.867377:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076104832 00000100:00100000:2.0:1775764808.867395:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076104832 00000100:00100000:2.0:1775764808.867523:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6498 00000100:00100000:2.0:1775764808.867550:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:47592:x1862023076104832:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:2.0:1775764808.867576:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764808.867604:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5333 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.867687:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523828 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.867720:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.867749:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764808.867843:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1775764808.867848:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764808.867873:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.867901:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5333 expref: 35 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.867925:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5333 expref: 34 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.868043:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764808.868047:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764808.868051:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0400, rc 0) 00000100:00100000:2.0:1775764808.868431:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:47592:x1862023076104832:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 897us (7208us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.868441:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6498 00000100:00100000:1.0:1775764808.875173:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.875446:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105088 00000100:00100000:3.0:1775764808.875459:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105088 00000100:00100000:3.0:1775764808.875519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6499 00000100:00100000:3.0:1775764808.875526:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:47592:x1862023076105088:12345-192.168.202.58@tcp:36:mkdir.0 00010000:00010000:3.0:1775764808.875598:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764808.875627:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523828 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5333 expref: 34 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.875648:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764808.875654:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764808.875865:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:47592:x1862023076105088:12345-192.168.202.58@tcp:36:mkdir.0 Request processed in 337us (701us total) trans 0 rc -17/-17 00000100:00100000:3.0:1775764808.875872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6499 00000100:00100000:3.0:1775764808.880981:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764808.883105:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105216 00000100:00100000:2.0:1775764808.883123:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105216 00000100:00100000:2.0:1775764808.883204:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6500 00000100:00100000:2.0:1775764808.883216:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+33:47592:x1862023076105216:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:2.0:1775764808.883239:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764808.883276:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52382f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd533a expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.883364:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523836 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.883381:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.883394:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764808.883442:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1775764808.883447:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764808.883465:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.883491:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed52382f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd533a expref: 35 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.883507:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd533a expref: 34 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.883516:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764808.883520:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764808.883524:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0600, rc 0) 00000100:00100000:2.0:1775764808.883621:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:47592:x1862023076105216:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 407us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.883628:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6500 00000100:00100000:0.0:1775764808.890963:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764808.891975:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105344 00000100:00100000:3.0:1775764808.891991:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105344 00000100:00100000:3.0:1775764808.892071:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6501 00000100:00100000:3.0:1775764808.892082:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+34:47592:x1862023076105344:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:3.0:1775764808.892116:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764808.892140:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52383d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5341 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892216:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892244:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892263:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892295:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892305:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x6e98bd47ed52380c expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892313:0:6523:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.892627:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x6e98bd47ed52380c expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764808.892647:0:6523:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1862023099807616:0@lo:104: 00000100:00100000:3.0:1775764808.892726:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.893008:0:6523:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2df6ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1775764808.893995:0:19521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099807616 00000100:00100000:1.0:1775764808.894007:0:19521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099807616 00000100:00100000:1.0:1775764808.894082:0:19521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1775764808.894090:0:19521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6523:x1862023099807616:12345-0@lo:104: 00010000:00010000:1.0:1775764808.894117:0:19521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.894215:0:19521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1775764808.894237:0:19521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6523:x1862023099807616:12345-0@lo:104: Request processed in 142us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764808.894244:0:19521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:1.0:1775764808.894276:0:9477:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775764808.894283:0:9477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.894290:0:9477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc1824ea0) 00010000:00010000:1.0:1775764808.894309:0:9477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764808.894318:0:9477:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.894360:0:9477:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.894366:0:9477:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1775764808.894390:0:9477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.894397:0:9477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96c1c1ba1600/0x6e98bd47ed52380c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x6e98bd47ed523813 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764808.894417:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764808.894419:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764808.894421:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764808.894429:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764808.894441:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099807744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1775764808.894475:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764808.894506:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099807744 00000100:00100000:1.0:1775764808.894510:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099807744 00010000:00010000:1.0:1775764808.894530:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x6e98bd47ed52380c expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764808.894569:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1775764808.894576:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3661:x1862023099807744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1775764808.894595:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1775764808.895824:0:6523:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1862023099807616:0@lo:104: 00010000:00010000:3.0:1775764808.895860:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1775764808.897677:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970659 is committed 00000001:00080000:1.0:1775764808.897692:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970658 is committed 00010000:00010000:2.0:1775764808.898044:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523813 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x6e98bd47ed52380c expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.898079:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54506945 (ffff96c1c7207a00) 00010000:00010000:2.0:1775764808.898085:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.898094:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.898178:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764808.898985:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764808.899124:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099807744:12345-0@lo:103:ldlm_bl.0 Request processed in 4545us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.899136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00010000:00010000:3.0:1775764808.899188:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764808.899197:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764808.899350:0:6523:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3603100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1862023099807872:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1775764808.899393:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764808.899424:0:6523:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2df6ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764808.899492:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099807872 00000100:00100000:2.0:1775764808.899500:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099807872 00000100:00100000:2.0:1775764808.899557:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1775764808.899566:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1862023099807872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1775764808.899649:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1862023099807872:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764808.899655:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1775764808.899744:0:6523:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3603100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1862023099807872:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1775764808.899832:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523852 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899855:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523852 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899865:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523852 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764808.899890:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523852 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899904:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899922:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899928:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899934:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899940:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764808.899945:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899952:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899964:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764808.899967:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764808.899971:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899977:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899992:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.899998:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900004:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900015:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764808.900018:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900024:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900032:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54506945 (ffff96c1c7207a00) 00010000:00010000:0.0:1775764808.900034:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764808.900036:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900042:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed52384b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900085:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52383d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5341 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900102:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6cc00/0x6e98bd47ed523852 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5341 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.900111:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c2c6356f00) 00010000:00010000:0.0:1775764808.900113:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1775764808.900115:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6cc00, rc 0) 00000100:00100000:0.0:1775764808.900170:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:47592:x1862023076105344:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 8091us (9222us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764808.900178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6501 00000100:00100000:3.0:1775764808.904249:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.904436:0:6533:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105472 00000100:00100000:0.0:1775764808.904461:0:6533:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105472 00000100:00100000:0.0:1775764808.904527:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 20 00000100:00100000:0.0:1775764808.904555:0:6533:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:47592:x1862023076105472:12345-192.168.202.58@tcp:900:mkdir.0 00000100:00100000:0.0:1775764808.904651:0:6533:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:47592:x1862023076105472:12345-192.168.202.58@tcp:900:mkdir.0 Request processed in 115us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764808.904659:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 20 00000100:00100000:1.0:1775764808.908159:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099807744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1775764808.911362:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764808.911660:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105600 00000100:00100000:0.0:1775764808.911672:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105600 00000100:00100000:0.0:1775764808.911746:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6502 00000100:00100000:0.0:1775764808.911758:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:47592:x1862023076105600:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:0.0:1775764808.911811:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764808.911918:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed523859 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5348 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.911985:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523860 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.912001:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523860 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.912014:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523860 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764808.912074:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1775764808.912078:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1775764808.912559:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed523859 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5348 expref: 9 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.912579:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523860 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5348 expref: 8 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764808.912605:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:0.0:1775764808.912608:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1775764808.912612:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d000, rc 0) 00000100:00100000:0.0:1775764808.912681:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:47592:x1862023076105600:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 925us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764808.912691:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6502 00000100:00100000:0.0:1775764809.016154:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764809.016177:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099808256:0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.016569:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099808000:0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.016613:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764809.016670:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764809.016675:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099808128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.016982:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808000 00000100:00100000:3.0:1775764809.016990:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808000 00000100:00100000:3.0:1775764809.017048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1775764809.017058:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.017131:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099808000:12345-0@lo:400:kworker.0 Request processed in 75us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764809.017138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1775764809.017172:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099808768:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.017205:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764809.017238:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099809280:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.017269:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764809.017287:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1775764809.017292:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099808384:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.017319:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808768 00000100:00100000:3.0:1775764809.017323:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808768 00000100:00100000:3.0:1775764809.017358:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099809280 00000100:00100000:3.0:1775764809.017362:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099809280 00000100:00100000:3.0:1775764809.017382:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1775764809.017389:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099808768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.017427:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099808768:12345-0@lo:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764809.017432:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1775764809.017444:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1775764809.017450:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099809280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.017477:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099809280:12345-0@lo:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764809.017497:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00080000:3.0:1775764809.017517:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764809.017521:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764809.018115:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764809.018472:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099808640:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.018521:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764809.018562:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099809152:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.018584:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764809.018623:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1775764809.018631:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099808512:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.018658:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764809.018678:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099809024:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.018697:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764809.018729:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808640 00000100:00100000:2.0:1775764809.018736:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808640 00000100:00100000:2.0:1775764809.018812:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099809152 00000100:00100000:2.0:1775764809.018815:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099809152 00000100:00100000:2.0:1775764809.019437:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1775764809.019448:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099808640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.019510:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099808640:12345-0@lo:400:kworker.0 Request processed in 65us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764809.019517:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1775764809.019534:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1775764809.019551:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099809152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.019581:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099809152:12345-0@lo:400:kworker.0 Request processed in 31us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764809.019586:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1775764809.019636:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099808640:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.019647:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099809152:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.019680:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808256 00000100:00100000:2.0:1775764809.019686:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808256 00000100:00100000:2.0:1775764809.019713:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808512 00000100:00100000:2.0:1775764809.019716:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808512 00000100:00100000:2.0:1775764809.019734:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099809024 00000100:00100000:2.0:1775764809.019737:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099809024 00000100:00100000:2.0:1775764809.020868:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1775764809.020893:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099808256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.020971:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099808256:12345-0@lo:400:kworker.0 Request processed in 89us (2858us total) trans 0 rc 0/0 00000100:00080000:3.0:1775764809.022709:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764809.022722:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764809.022725:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764809.022758:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764809.022890:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099808000:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.022924:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764809.022950:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099808896:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.023001:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764809.023028:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099808768:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.023040:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099809280:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.023074:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808128 00000100:00100000:3.0:1775764809.023080:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808128 00000100:00100000:1.0:1775764809.028788:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:1.0:1775764809.028817:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099808512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.028924:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099808512:12345-0@lo:400:kworker.0 Request processed in 122us (10265us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.028930:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:1.0:1775764809.028961:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808384 00000100:00100000:1.0:1775764809.028968:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808384 00000100:00100000:1.0:1775764809.028998:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099808896 00000100:00100000:1.0:1775764809.029000:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099808896 00000100:00100000:1.0:1775764809.029010:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:1.0:1775764809.029014:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099809024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.029035:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099809024:12345-0@lo:400:kworker.0 Request processed in 21us (10338us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.029039:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:1.0:1775764809.029046:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1775764809.029049:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099808384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.029068:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099808384:12345-0@lo:400:kworker.0 Request processed in 18us (6144us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.029086:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1775764809.029106:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1775764809.029110:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099808896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.029130:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099808896:12345-0@lo:400:kworker.0 Request processed in 20us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.029133:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00080000:1.0:1775764809.029151:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764809.029180:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099808384:0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.029189:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099808896:0@lo:400:kworker.0 00000100:00100000:1.0:1775764809.029265:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099808256:0@lo:400:kworker.0 00000100:00100000:0.0:1775764809.030870:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099808512:0@lo:400:kworker.0 00000100:00100000:0.0:1775764809.030885:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099809024:0@lo:400:kworker.0 00000100:00100000:2.0:1775764809.031612:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1775764809.031887:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1775764809.031906:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099808128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.032064:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099808128:12345-0@lo:400:kworker.0 Request processed in 168us (9309us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764809.032071:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:0.0:1775764809.032134:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099808128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764809.039742:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764809.039845:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105728 00000100:00100000:1.0:1775764809.039855:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105728 00000100:00100000:1.0:1775764809.039914:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6503 00000100:00100000:1.0:1775764809.039923:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+46:47598:x1862023076105728:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764809.039947:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764809.039969:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd534f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.040039:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.040055:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.040066:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764809.040570:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764809.040575:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764809.040601:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.040633:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.040652:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.040662:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764809.040664:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764809.040668:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4c00, rc 0) 00000100:00100000:1.0:1775764809.041458:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+47:47598:x1862023076105728:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1531us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.041468:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6503 00000100:00100000:1.0:1775764809.051567:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.051663:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076105984 00000100:00100000:0.0:1775764809.051674:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076105984 00000100:00100000:0.0:1775764809.051735:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6504 00000100:00100000:0.0:1775764809.051746:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:47598:x1862023076105984:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764809.052567:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764809.052572:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1775764809.052605:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523860 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5348 expref: 8 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.052624:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:0.0:1775764809.052629:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764809.052659:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed523875 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5356 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.053474:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.053491:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.053502:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.053519:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1:0x0].0x48433402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.053526:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.053532:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764809.053696:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3767800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:14288:1862023099809408:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1775764809.053816:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764809.053856:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c4ff2600 going to sleep for 11 seconds 00000100:00100000:2.0:1775764809.054128:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099809408 00000100:00100000:2.0:1775764809.054136:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099809408 00000100:00100000:2.0:1775764809.054246:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1775764809.054263:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:14288:x1862023099809408:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1775764809.054345:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:14288:x1862023099809408:12345-0@lo:1000:mdt00_005.0 Request processed in 83us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764809.054353:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1775764809.054687:0:14288:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294970659 gen 2 00000004:00080000:0.0:1775764809.054693:0:14288:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294970659 committed transno 4294970659 00000100:00100000:0.0:1775764809.054752:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3767800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:14288:1862023099809408:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1775764809.055206:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055220:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055263:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764809.055278:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 0 00010000:00010000:0.0:1775764809.055309:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055316:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055323:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055329:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764809.055334:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055342:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055355:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:0.0:1775764809.055357:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764809.055362:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055368:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed52387c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764809.055382:0:14288:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000120d8639 reply state 00000000ca01fa06 transno 4294968426 ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055404:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055410:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x48433402 (ffff96c2c6356100) 00010000:00010000:0.0:1775764809.055412:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1775764809.055415:0:14288:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1775764809.055453:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed523875 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 10 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055468:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 9 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.055476:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:0.0:1775764809.055478:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764809.055481:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d800, rc 0) 00000100:00100000:0.0:1775764809.055550:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:47598:x1862023076105984:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 3806us (3993us total) trans 4294968426 rc 0/0 00000100:00100000:0.0:1775764809.055557:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6504 00000100:00100000:2.0:1775764809.062170:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.062582:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076106240 00000100:00100000:0.0:1775764809.062593:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076106240 00000100:00100000:0.0:1775764809.062656:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6505 00000100:00100000:0.0:1775764809.062666:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:47598:x1862023076106240:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764809.062691:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764809.062712:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523898 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd535d expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.062883:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.062915:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 11 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.062924:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.062960:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 11 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.062973:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 11 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764809.062987:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3767800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:24980:1862023099809536:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764809.063068:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c9791540 going to sleep for 11 seconds 00000100:00100000:0.0:1775764809.069807:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3767800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:24980:1862023099809536:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764809.069851:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764809.072271:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.072821:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076106368 00000100:00100000:0.0:1775764809.072842:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076106368 00010000:00010000:0.0:1775764809.072894:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 12 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764809.072943:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1408 00000100:00100000:0.0:1775764809.072954:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:2411:x1862023076106368:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764809.072973:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764809.073002:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 12 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.073018:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 12 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.073050:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed52388a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5356 expref: 12 pid: 14288 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.073073:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:0.0:1775764809.073080:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.073105:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.073115:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.073158:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764809.073242:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2411:x1862023076106368:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 288us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764809.073462:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1408 00010000:00010000:2.0:1775764809.073560:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073570:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764809.073594:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 0 00010000:00010000:2.0:1775764809.073877:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073885:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073892:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073911:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764809.073916:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073923:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073934:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:2.0:1775764809.073936:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764809.073940:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.073945:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed52389f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.074004:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523898 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd535d expref: 11 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.074014:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:2.0:1775764809.074016:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764809.074020:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523898 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd535d expref: 11 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.074029:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ce00, rc 0) 00000100:00100000:2.0:1775764809.074065:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:47598:x1862023076106240:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 11401us (11907us total) trans 4294968427 rc 301/301 00000100:00100000:2.0:1775764809.074073:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6505 00000100:00100000:1.0:1775764809.078066:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.078550:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076106624 00000100:00100000:0.0:1775764809.078562:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076106624 00000100:00100000:0.0:1775764809.078616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1365 00000100:00100000:0.0:1775764809.078626:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:47598:x1862023076106624:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1775764809.083618:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:47598:x1862023076106624:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 4985us (5553us total) trans 4294968428 rc 0/0 00000100:00100000:0.0:1775764809.083647:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1365 00000100:00100000:1.0:1775764809.088093:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764809.088496:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076106752 00000100:00100000:2.0:1775764809.088523:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076106752 00000100:00100000:2.0:1775764809.088590:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6506 00000100:00100000:2.0:1775764809.088600:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:47598:x1862023076106752:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764809.088629:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764809.088651:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5238ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5364 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.088712:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5238ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5364 expref: 12 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.088727:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5238ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5364 expref: 12 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.088747:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764809.088751:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1775764809.088756:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1000, rc 0) 00000100:00100000:2.0:1775764809.089212:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:47598:x1862023076106752:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 611us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764809.089221:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6506 00000100:00100000:3.0:1775764809.092914:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764809.093111:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076107008 00000100:00100000:1.0:1775764809.093123:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076107008 00000100:00100000:1.0:1775764809.093177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6507 00000100:00100000:1.0:1775764809.093187:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+12:47598:x1862023076107008:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1775764809.093265:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093304:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093315:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093463:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093470:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093476:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093482:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764809.093486:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093493:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093505:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764809.093508:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1775764809.093513:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.093519:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5238b4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764809.093607:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+13:47598:x1862023076107008:12345-192.168.202.58@tcp:55:lhsmtool_posix.0 Request processed in 420us (702us total) trans 4294968429 rc 0/0 00000100:00100000:1.0:1775764809.093622:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6507 00000100:00100000:1.0:1775764809.096997:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764809.097091:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076107264 00000100:00100000:2.0:1775764809.097112:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076107264 00000100:00100000:2.0:1775764809.097171:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6508 00000100:00100000:2.0:1775764809.097181:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+13:47598:x1862023076107264:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1775764809.097431:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.097447:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.097473:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1775764809.097840:0:14288:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294968430 00000004:00010000:2.0:1775764809.097874:0:14288:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000762e7b4f reply state 000000007503f9c7 transno 4294968431 ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.097888:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.097897:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764809.097899:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1775764809.097903:0:14288:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1775764809.097994:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+16:47598:x1862023076107264:12345-192.168.202.58@tcp:36:lhsmtool_posix.0 Request processed in 813us (1004us total) trans 4294968431 rc 0/0 00000100:00100000:2.0:1775764809.098002:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6508 00000020:00080000:2.0:1775764809.098007:0:14288:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1775764809.101910:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764809.102117:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076107520 00000100:00100000:1.0:1775764809.102127:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076107520 00000100:00100000:1.0:1775764809.102183:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1366 00000100:00100000:1.0:1775764809.102193:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+16:47598:x1862023076107520:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764809.102648:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+17:47598:x1862023076107520:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 455us (747us total) trans 4294968432 rc 0/0 00000100:00100000:1.0:1775764809.102656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1366 00000100:00100000:1.0:1775764809.144366:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764809.144829:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076107648 00000100:00100000:2.0:1775764809.144853:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076107648 00000100:00100000:2.0:1775764809.144917:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6509 00000100:00100000:2.0:1775764809.144926:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:47599:x1862023076107648:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764809.144950:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764809.144976:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd536b expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145052:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145070:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145100:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145118:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145125:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145131:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145199:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5238d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145208:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5238d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145215:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5238d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764809.145263:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5238d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145278:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145284:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145290:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145305:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145311:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764809.145315:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145323:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145338:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764809.145341:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764809.145345:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145352:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145366:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145371:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145377:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145382:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764809.145385:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145403:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145411:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54506945 (ffff96c1c7207b00) 00010000:00010000:2.0:1775764809.145413:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764809.145416:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145422:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54506945 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145454:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd536b expref: 37 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145468:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5238d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd536b expref: 36 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.145476:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c2c6356f00) 00010000:00010000:2.0:1775764809.145479:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764809.145481:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1600, rc 0) 00000100:00100000:2.0:1775764809.146190:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:47599:x1862023076107648:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1260us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764809.146201:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6509 00000100:00100000:1.0:1775764809.156239:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764809.156516:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.156607:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076107904 00000100:00100000:0.0:1775764809.156621:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076107904 00000100:00100000:0.0:1775764809.156692:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 748 00000100:00100000:0.0:1775764809.156703:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:2410:x1862023076107904:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764809.156723:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764809.156750:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed5238d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd536b expref: 36 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.156806:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c2c6356f00) 00010000:00010000:0.0:1775764809.156812:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764809.156882:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:2410:x1862023076107904:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 181us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764809.156890:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 748 00000100:00100000:3.0:1775764809.159111:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076107776 00000100:00100000:3.0:1775764809.159128:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076107776 00000100:00100000:3.0:1775764809.159243:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6510 00000100:00100000:3.0:1775764809.159277:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+17:47599:x1862023076107776:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764809.159309:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764809.159333:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5238de lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5372 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.159393:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5238e5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.159407:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5238e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.159419:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5238e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764809.159460:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1775764809.159464:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1775764809.159502:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed5238de lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5372 expref: 19 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.159519:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d8c00/0x6e98bd47ed5238e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5372 expref: 18 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.159528:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:3.0:1775764809.159531:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1775764809.159551:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8c00, rc 0) 00000100:00100000:3.0:1775764809.159622:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+18:47599:x1862023076107776:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 347us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764809.159629:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6510 00000100:00100000:1.0:1775764809.165329:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764809.165409:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076108160 00000100:00100000:2.0:1775764809.165420:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076108160 00000100:00100000:2.0:1775764809.165481:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6511 00000100:00100000:2.0:1775764809.165492:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+18:47599:x1862023076108160:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764809.165531:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764809.165564:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5379 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165642:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165659:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165671:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165684:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165691:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165699:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165876:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165885:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.165892:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764809.165903:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 158 00010000:00010000:2.0:1775764809.166000:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166008:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166014:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166022:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166028:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764809.166034:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166042:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166057:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:2.0:1775764809.166061:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764809.166067:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166073:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed5238f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166087:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166093:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166099:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166110:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764809.166113:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166119:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166128:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x48433402 (ffff96c2c6356100) 00010000:00010000:2.0:1775764809.166130:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764809.166132:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166138:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed5238fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166178:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed5238ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166192:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764809.166199:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764809.166201:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764809.166204:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cf600, rc 0) 00000100:00100000:2.0:1775764809.166272:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:47599:x1862023076108160:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 781us (952us total) trans 4294968433 rc 0/0 00000100:00100000:2.0:1775764809.166282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6511 00000100:00100000:2.0:1775764809.170450:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764809.170556:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076108416 00000100:00100000:3.0:1775764809.170574:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076108416 00000100:00100000:3.0:1775764809.170644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6512 00000100:00100000:3.0:1775764809.170654:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:47599:x1862023076108416:12345-192.168.202.58@tcp:55:lfs.0 00010000:00010000:3.0:1775764809.170738:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.170755:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.170765:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 4/0,1 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.170854:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.170867:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 20 pid: 6521 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764809.170883:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3601880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6522:1862023099809664:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764809.170984:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c1229e40 going to sleep for 11 seconds 00000100:00100000:1.0:1775764809.174185:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.174287:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076108544 00000100:00100000:0.0:1775764809.174301:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076108544 00010000:00010000:0.0:1775764809.174354:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 21 pid: 6521 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764809.174398:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1409 00000100:00100000:0.0:1775764809.174408:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:2411:x1862023076108544:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764809.174427:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764809.174436:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 21 pid: 6521 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.174449:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 21 pid: 6521 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.174487:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764809.174493:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.174504:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.174512:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.174546:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764809.174611:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:2411:x1862023076108544:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 204us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764809.174619:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1409 00010000:00010000:3.0:1775764809.175168:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c43cf600/0x6e98bd47ed523901 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5379 expref: 20 pid: 6521 timeout: 1416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764809.175186:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3601880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6522:1862023099809664:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764809.175214:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175233:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175249:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175427:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175435:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175441:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175447:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764809.175452:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175459:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175473:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764809.175476:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1775764809.175480:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 2/0,0 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764809.175486:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52390f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764809.175725:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:47599:x1862023076108416:12345-192.168.202.58@tcp:55:lfs.0 Request processed in 5071us (5285us total) trans 4294968434 rc 0/0 00000100:00100000:3.0:1775764809.175735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6512 00000100:00100000:1.0:1775764809.181134:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.181215:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076108800 00000100:00100000:0.0:1775764809.181366:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076108800 00000100:00100000:0.0:1775764809.181430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1367 00000100:00100000:0.0:1775764809.181439:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+20:47599:x1862023076108800:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:0.0:1775764809.182055:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:47599:x1862023076108800:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 614us (929us total) trans 4294968435 rc 0/0 00000100:00100000:0.0:1775764809.182064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1367 00000100:00100000:2.0:1775764809.199283:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764809.199380:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076109056 00000100:00100000:0.0:1775764809.199390:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076109056 00000100:00100000:0.0:1775764809.199454:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6513 00000100:00100000:0.0:1775764809.199464:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:47600:x1862023076109056:12345-192.168.202.58@tcp:101:md5sum.0 00010000:00010000:0.0:1775764809.199491:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764809.199526:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523916 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5380 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199612:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199626:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199640:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199651:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199658:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199665:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199817:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52392b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199826:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52392b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199843:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52392b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764809.199855:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 158 00010000:00010000:0.0:1775764809.199954:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199972:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199979:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199984:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6dc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764809.199989:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.199997:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200011:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:0.0:1775764809.200014:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764809.200019:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200025:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed52391d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200041:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200046:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200052:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200056:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764809.200065:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200071:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200079:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x48433402 (ffff96c2c6356100) 00010000:00010000:0.0:1775764809.200082:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764809.200085:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200091:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523924 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200148:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523916 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5380 expref: 24 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200162:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52392b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5380 expref: 23 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764809.200170:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764809.200172:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764809.200175:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d000, rc 0) 00000100:00100000:0.0:1775764809.200237:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:47600:x1862023076109056:12345-192.168.202.58@tcp:101:md5sum.0 Request processed in 775us (966us total) trans 4294968436 rc 0/0 00000100:00100000:0.0:1775764809.200245:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6513 00000100:00100000:2.0:1775764809.208673:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764809.209548:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076109312 00000100:00100000:1.0:1775764809.209560:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076109312 00000100:00100000:1.0:1775764809.209669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 749 00000100:00100000:1.0:1775764809.209681:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+23:47600:x1862023076109312:12345-192.168.202.58@tcp:103:md5sum.0 00010000:00010000:1.0:1775764809.209700:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1775764809.209726:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52392b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5380 expref: 23 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.209744:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed5238ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5364 expref: 22 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764809.209801:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764809.209808:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764809.209981:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:47600:x1862023076109312:12345-192.168.202.58@tcp:103:md5sum.0 Request processed in 304us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.209987:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 749 00000100:00100000:2.0:1775764809.212157:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764809.212352:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076109440 00000100:00100000:3.0:1775764809.212363:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076109440 00000100:00100000:3.0:1775764809.212420:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6514 00000100:00100000:3.0:1775764809.212430:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:47600:x1862023076109440:12345-192.168.202.58@tcp:58:md5sum.0 00000100:00100000:3.0:1775764809.212606:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:47600:x1862023076109440:12345-192.168.202.58@tcp:58:md5sum.0 Request processed in 177us (458us total) trans 0 rc -1/-1 00000100:00100000:3.0:1775764809.212614:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6514 00000100:00100000:2.0:1775764809.216749:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764809.216951:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076109696 00000100:00100000:3.0:1775764809.216965:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076109696 00000100:00100000:3.0:1775764809.217034:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1368 00000100:00100000:3.0:1775764809.217045:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df700850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+21:47600:x1862023076109696:12345-192.168.202.58@tcp:35:md5sum.0 00000100:00100000:3.0:1775764809.217319:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df700850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:47600:x1862023076109696:12345-192.168.202.58@tcp:35:md5sum.0 Request processed in 275us (581us total) trans 4294968437 rc 0/0 00000100:00100000:3.0:1775764809.217326:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1368 00000100:00100000:1.0:1775764809.522330:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764809.522414:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764809.522568:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099809792 00000100:00100000:0.0:1775764809.522578:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099809792 00000100:00100000:0.0:1775764809.522640:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1775764809.522650:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099809792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1775764809.522701:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:0.0:1775764809.522758:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099809792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764809.522766:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1775764809.522991:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764809.523348:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1775764809.523359:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099809920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764809.523394:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764809.523512:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099809920 00000100:00100000:1.0:1775764809.523517:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099809920 00000100:00100000:1.0:1775764809.523560:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1775764809.523567:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099809920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764809.523580:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:1.0:1775764809.523621:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099809920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764809.523628:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1775764809.523696:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099809920:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1775764809.589051:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764810.610170:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764811.570223:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764811.570255:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099810048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764811.570352:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764811.570566:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810048 00000100:00100000:3.0:1775764811.570577:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810048 00000100:00100000:3.0:1775764811.570644:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1775764811.570656:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099810048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764811.570700:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444229120 avail 1297989632 00000100:00100000:3.0:1775764811.570766:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099810048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764811.570823:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1775764811.570825:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099810048:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764811.634136:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764812.594040:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099810176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764812.594117:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764812.594327:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810176 00000100:00100000:1.0:1775764812.594338:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810176 00000100:00100000:1.0:1775764812.594405:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1775764812.594414:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099810176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764812.594442:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764812.594508:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099810176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764812.594516:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00080000:1.0:1775764812.594538:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764812.594579:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099810176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764812.595206:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764812.597183:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099810304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764812.597379:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764812.597522:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810304 00000100:00100000:0.0:1775764812.597531:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810304 00000100:00100000:0.0:1775764812.597604:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1775764812.597612:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099810304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764812.597636:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:0.0:1775764812.597688:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099810304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764812.597695:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1775764812.597862:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099810304:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1775764812.598077:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1775764812.659552:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764813.620359:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1775764813.620386:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099810432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1775764813.620458:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764813.620589:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810432 00000100:00100000:1.0:1775764813.620597:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810432 00000100:00100000:1.0:1775764813.620652:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1775764813.620661:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099810432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764813.620695:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1775764813.621028:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099810432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 367us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764813.621037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1775764813.625113:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099810432:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1775764813.692708:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764813.957715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.957827:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.957857:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.957889:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.957911:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.957929:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.957953:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764813.957966:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110336 00000100:00100000:3.0:1775764813.957978:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110336 00000100:00100000:1.0:1775764813.957990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764813.958044:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764813.958062:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110848 00000100:00100000:3.0:1775764813.958066:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110848 00000100:00100000:1.0:1775764813.958080:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110208 00000100:00100000:1.0:1775764813.958086:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110208 00000100:00100000:3.0:1775764813.958094:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110720 00000100:00100000:3.0:1775764813.958098:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110720 00000100:00100000:1.0:1775764813.958120:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1387 00000100:00100000:2.0:1775764813.958181:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110080 00000100:00100000:2.0:1775764813.958185:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110080 00000100:00100000:2.0:1775764813.958216:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110592 00000100:00100000:2.0:1775764813.958219:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110592 00000100:00100000:2.0:1775764813.958239:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076109952 00000100:00100000:2.0:1775764813.958242:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076109952 00000100:00100000:2.0:1775764813.958257:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110464 00000100:00100000:2.0:1775764813.958260:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110464 00000100:00100000:3.0:1775764813.958281:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1388 00000100:00100000:2.0:1775764813.958286:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1905 00000100:00100000:2.0:1775764813.958306:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076110080:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764813.958388:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076110080:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 94us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764813.958396:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1905 00000100:00100000:2.0:1775764813.958431:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1906 00000100:00100000:2.0:1775764813.958437:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:2411:x1862023076110592:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764813.958468:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+22:2411:x1862023076110592:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764813.958474:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1906 00000100:00100000:2.0:1775764813.958508:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1907 00000100:00100000:2.0:1775764813.958515:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:2411:x1862023076109952:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764813.958547:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:2411:x1862023076109952:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764813.958553:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1907 00000100:00100000:2.0:1775764813.958565:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1908 00000100:00100000:2.0:1775764813.958571:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:2411:x1862023076110464:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764813.958592:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:2411:x1862023076110464:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764813.958598:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1908 00000100:00100000:2.0:1775764813.958809:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1389 00000100:00100000:2.0:1775764813.958818:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076110208:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764813.958850:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+5:2411:x1862023076110208:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 35us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764813.958856:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1389 00000100:00100000:2.0:1775764813.958870:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1390 00000100:00100000:2.0:1775764813.958876:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076110720:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764813.958898:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2411:x1862023076110720:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764813.958911:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1390 00000100:00080000:2.0:1775764813.958928:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764813.958932:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1775764813.958935:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1775764813.958937:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764813.958994:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076109824 00000100:00100000:0.0:1775764813.959000:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076109824 00000100:00100000:0.0:1775764813.959031:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 965 00000100:00100000:0.0:1775764813.959038:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076109824:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764813.959065:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076109824:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764813.959071:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 965 00000100:00100000:1.0:1775764813.959502:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076110336:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764813.959544:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076110336:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 1416us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764813.959550:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1387 00000100:00100000:3.0:1775764813.965191:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076110848:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764813.965305:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076110848:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 7015us (7391us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764813.965316:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1388 00000100:00100000:2.0:1775764814.125503:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764814.125832:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076110976 00000100:00100000:0.0:1775764814.125844:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076110976 00000100:00100000:0.0:1775764814.125925:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6515 00000100:00100000:0.0:1775764814.125935:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:47554:x1862023076110976:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764814.126059:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+47:47554:x1862023076110976:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 116us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764814.126068:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6515 00000100:00100000:3.0:1775764814.130407:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099810560:0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.130648:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099810944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.130673:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099810688:0@lo:400:kworker.0 00000100:00100000:1.0:1775764814.131125:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099810816:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.137611:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764814.137687:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099811200:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.137879:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764814.137908:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099811712:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.137931:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764814.137973:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810688 00000100:00100000:2.0:1775764814.137980:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810688 00000100:00100000:2.0:1775764814.138021:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811200 00000100:00100000:2.0:1775764814.138024:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811200 00000100:00100000:2.0:1775764814.138053:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811712 00000100:00100000:2.0:1775764814.138056:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811712 00000100:00100000:2.0:1775764814.138078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1775764814.138086:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099810688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.138144:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099810688:12345-0@lo:400:kworker.0 Request processed in 58us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764814.138152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1775764814.138174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1775764814.138181:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099811200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.138201:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764814.138215:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099811200:12345-0@lo:400:kworker.0 Request processed in 34us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764814.138236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1775764814.138244:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099811072:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.138267:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1775764814.138279:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099811712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.138279:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764814.138304:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099811584:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.138321:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099811712:12345-0@lo:400:kworker.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764814.138328:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:3.0:1775764814.138334:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764814.138345:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811072 00000100:00100000:2.0:1775764814.138349:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811072 00000100:00100000:3.0:1775764814.138355:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1775764814.138364:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099811456:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.138368:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811584 00000100:00100000:2.0:1775764814.138372:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811584 00000100:00100000:2.0:1775764814.138392:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1775764814.138397:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764814.138403:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099811072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.138422:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099811968:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.138443:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099811072:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764814.138451:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764814.138514:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099811072:0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.138565:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810560 00000100:00100000:3.0:1775764814.138569:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810560 00000100:00100000:3.0:1775764814.138603:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1775764814.138610:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099810560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764814.138642:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764814.138672:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099811328:0@lo:400:kworker.0 00000100:00100000:1.0:1775764814.138696:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764814.138715:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099811840:0@lo:400:kworker.0 00000100:00100000:1.0:1775764814.138847:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764814.138921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764814.139045:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076111104 00000100:00100000:1.0:1775764814.139063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1775764814.139072:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099811584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.139125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00080000:2.0:1775764814.139151:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764814.139156:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764814.139179:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099810688:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.139191:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099811200:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.139200:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099811712:0@lo:400:kworker.0 00000100:00100000:2.0:1775764814.139244:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811456 00000100:00100000:2.0:1775764814.139248:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811456 00000100:00100000:2.0:1775764814.139277:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811968 00000100:00100000:2.0:1775764814.139280:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811968 00000100:00100000:2.0:1775764814.139295:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811328 00000100:00100000:2.0:1775764814.139297:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811328 00000100:00100000:2.0:1775764814.139321:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099811840 00000100:00100000:2.0:1775764814.139323:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099811840 00000100:00100000:2.0:1775764814.139335:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1775764814.139341:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099811456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.139524:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076111104 00000100:00100000:0.0:1775764814.139558:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6516 00000100:00100000:0.0:1775764814.139565:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:47554:x1862023076111104:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764814.140425:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:47554:x1862023076111104:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 856us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764814.140434:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6516 00000100:00100000:0.0:1775764814.141274:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1775764814.141287:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099811968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.141410:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099810560:12345-0@lo:400:kworker.0 Request processed in 2800us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764814.141420:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1775764814.141566:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810816 00000100:00100000:3.0:1775764814.141574:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810816 00000100:00100000:3.0:1775764814.141614:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1775764814.141621:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099810816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.141805:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099810816:12345-0@lo:400:kworker.0 Request processed in 184us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764814.141818:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1775764814.147701:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099811584:12345-0@lo:400:kworker.0 Request processed in 8620us (9356us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764814.147716:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1775764814.147814:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764814.148098:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099810816:0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.150074:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099811968:12345-0@lo:400:kworker.0 Request processed in 8783us (11615us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764814.150087:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1775764814.150137:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1775764814.150152:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099811328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.150246:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099811328:12345-0@lo:400:kworker.0 Request processed in 102us (11549us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764814.150252:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1775764814.150264:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:0.0:1775764814.150285:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099811840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.150317:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099811840:12345-0@lo:400:kworker.0 Request processed in 34us (11469us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764814.150322:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1775764814.150679:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099811328:0@lo:400:kworker.0 00000100:00100000:1.0:1775764814.150692:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099811840:0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.151000:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099810944 00000100:00100000:0.0:1775764814.151009:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099810944 00000100:00100000:0.0:1775764814.151055:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1775764814.151061:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099810944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.151106:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099810944:12345-0@lo:400:kworker.0 Request processed in 45us (3292us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764814.151113:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00080000:0.0:1775764814.151165:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764814.151170:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764814.151442:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099810944:0@lo:400:kworker.0 00000001:00080000:1.0:1775764814.154161:0:7436:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968437 is committed 00000020:00080000:1.0:1775764814.154200:0:7436:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff96c1c2c0a240 refcount 2 committed 0 result 0 batchid 53 00000020:00080000:1.0:1775764814.154205:0:7436:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c447b800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2c0a3c0 00000020:00080000:1.0:1775764814.154223:0:7436:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].3 00000020:00080000:1.0:1775764814.154226:0:7436:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c447bd00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c1c2c76c00 00000020:00080000:1.0:1775764814.154228:0:7436:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].3 00000020:00080000:1.0:1775764814.154251:0:7457:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 53 committed batchid 52 00000020:00080000:1.0:1775764814.154317:0:7457:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 52 00010000:00010000:0.0:1775764814.154449:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154469:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154476:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154481:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764814.154486:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154502:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154520:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff96c1c2a04200) 00010000:00010000:0.0:1775764814.154528:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764814.154534:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154540:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed52381a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154560:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154565:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154571:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154576:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764814.154579:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154585:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154593:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x48433402 (ffff96c2c6356100) 00010000:00010000:0.0:1775764814.154596:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764814.154598:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154604:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523883 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1:0x0].0x48433402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154623:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154634:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154639:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154643:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764814.154646:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154652:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154660:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764814.154662:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1775764814.154665:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764814.154670:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed5238bb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764814.156159:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099811456:12345-0@lo:400:kworker.0 Request processed in 16808us (17754us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764814.156174:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1775764814.156205:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099811456:0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.156225:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099811968:0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.156237:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099810560:0@lo:400:kworker.0 00000100:00100000:3.0:1775764814.156250:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099811584:0@lo:400:kworker.0 00000100:00100000:0.0:1775764814.642220:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c55b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099812096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764814.642297:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764814.642461:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775764814.642479:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099812224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764814.642518:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764814.642566:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099812096 00000100:00100000:1.0:1775764814.642574:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099812096 00000100:00100000:1.0:1775764814.642623:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099812224 00000100:00100000:1.0:1775764814.642626:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099812224 00000100:00100000:1.0:1775764814.642643:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1775764814.642651:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099812096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764814.642696:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:2.0:1775764814.642800:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1775764814.642809:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099812224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764814.642819:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:2.0:1775764814.642853:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099812224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764814.642860:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1775764814.643340:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099812224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764814.649213:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099812096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6552us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764814.649227:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1775764814.650097:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c55b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099812096:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1775764814.706185:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764815.732123:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764815.929333:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764815.929343:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764815.929450:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 149 count 1 00000040:00080000:1.0:1775764815.929458:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1775764816.480966:0:30615:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 16:00:13 (1775764813) 00000100:00100000:2.0:1775764816.690068:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099812352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764816.690152:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764816.690331:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099812352 00000100:00100000:1.0:1775764816.690339:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099812352 00000100:00100000:1.0:1775764816.690392:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1775764816.690401:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099812352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764816.690436:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444229120 avail 1297989632 00000100:00100000:1.0:1775764816.690507:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099812352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764816.690514:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1775764816.690621:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099812352:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1775764816.755088:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764816.809621:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764816.809862:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076111360 00000100:00100000:0.0:1775764816.809875:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076111360 00000100:00080000:2.0:1775764816.809957:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764816.809962:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6517 00000100:00100000:0.0:1775764816.809973:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+47:48223:x1862023076111360:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764816.810014:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764816.810040:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523939 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5387 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810235:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810397:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810413:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810430:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810437:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810444:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810837:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52394e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810848:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52394e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.810856:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52394e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764816.810866:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1775764816.811009:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811017:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811037:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811042:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.811046:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811053:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811072:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:1.0:1775764816.811075:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.811080:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811086:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523940 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811100:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811115:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811121:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811126:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.811129:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811135:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811143:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c2c894c300) 00010000:00010000:1.0:1775764816.811145:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.811148:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811153:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523947 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811421:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523939 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5387 expref: 50 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811436:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52394e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5387 expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.811443:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:1.0:1775764816.811445:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.811453:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ce00, rc 0) 00000100:00100000:1.0:1775764816.811678:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:48223:x1862023076111360:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1706us (2066us total) trans 4294970660 rc 0/0 00000100:00100000:1.0:1775764816.811687:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6517 00000100:00100000:0.0:1775764816.822621:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764816.822668:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764816.822979:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076111744 00000100:00100000:1.0:1775764816.822991:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076111744 00000100:00100000:1.0:1775764816.823200:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 750 00000100:00100000:1.0:1775764816.823211:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:2410:x1862023076111744:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764816.823228:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764816.823255:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed52394e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5387 expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.823275:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:1.0:1775764816.823280:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764816.823339:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+48:2410:x1862023076111744:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 130us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764816.823348:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 750 00000100:00100000:3.0:1775764816.823429:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076111616 00000100:00100000:3.0:1775764816.823434:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076111616 00000100:00100000:3.0:1775764816.823475:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1369 00000100:00100000:3.0:1775764816.823484:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+48:48223:x1862023076111616:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764816.823731:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+49:48223:x1862023076111616:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 249us (1124us total) trans 4294970661 rc 0/0 00000100:00100000:3.0:1775764816.823738:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1369 00000100:00100000:2.0:1775764816.839626:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764816.839745:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076111872 00000100:00100000:1.0:1775764816.839756:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076111872 00000100:00100000:1.0:1775764816.839848:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6518 00000100:00100000:1.0:1775764816.839859:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:48223:x1862023076111872:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764816.840000:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:48223:x1862023076111872:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 142us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764816.840009:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6518 00000100:00100000:0.0:1775764816.854689:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.854954:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112000 00000100:00100000:2.0:1775764816.854966:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112000 00000100:00100000:2.0:1775764816.855061:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6519 00000100:00100000:2.0:1775764816.855071:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:48223:x1862023076112000:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1775764816.855367:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764816.855545:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:48223:x1862023076112000:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 474us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764816.855569:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6519 00000100:00100000:0.0:1775764816.866502:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764816.866711:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112128 00000100:00100000:1.0:1775764816.866723:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112128 00000100:00100000:1.0:1775764816.866864:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6520 00000100:00100000:1.0:1775764816.866891:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:48224:x1862023076112128:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764816.866918:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764816.866939:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52395c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd538e expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867015:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867030:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867042:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867057:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867064:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867071:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867115:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867122:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867128:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867145:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867151:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.867155:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867162:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867175:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764816.867178:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.867182:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867188:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867202:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867207:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867213:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867217:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.867219:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867234:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867243:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x832cc65c (ffff96c2c7ea7700) 00010000:00010000:1.0:1775764816.867245:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.867248:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867253:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed52396a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867287:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52395c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd538e expref: 36 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867296:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764816.867299:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.867302:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed52395c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd538e expref: 36 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.867311:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5a00, rc 0) 00000100:00080000:0.0:1775764816.868090:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764816.868133:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:48224:x1862023076112128:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1241us (1669us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764816.868144:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6520 00000100:00100000:1.0:1775764816.872878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764816.872959:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112384 00000100:00100000:0.0:1775764816.872970:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112384 00000100:00100000:0.0:1775764816.873032:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6521 00000100:00100000:0.0:1775764816.873042:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+35:48224:x1862023076112384:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:0.0:1775764816.873093:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764816.873119:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523836 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd533a expref: 35 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.873137:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764816.873143:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764816.873207:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.873222:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.873231:0:10681:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.873263:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.873276:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 48 pid: 6523 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764816.873306:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099812480:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764816.873412:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c6205d80 going to sleep for 11 seconds 00000100:00100000:0.0:1775764816.876220:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099812480:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764816.876247:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764816.877338:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764816.877479:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112512 00000100:00100000:0.0:1775764816.877488:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112512 00010000:00010000:0.0:1775764816.877524:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 49 pid: 6523 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764816.877560:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1410 00000100:00100000:0.0:1775764816.877568:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:2411:x1862023076112512:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764816.877583:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764816.877589:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 49 pid: 6523 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.877601:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 49 pid: 6523 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.877621:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed52386e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd534f expref: 49 pid: 6523 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.877635:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764816.877640:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.877660:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.877668:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.877701:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764816.877752:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:2411:x1862023076112512:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 185us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764816.877801:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1410 00010000:00010000:2.0:1775764816.878350:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878360:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878387:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x832cc65c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878396:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878405:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878961:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878971:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.878979:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764816.878993:0:10681:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003267dad3 reply state 000000000813e1cf transno 4294970662 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879004:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879011:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.879020:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764816.879025:0:10681:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1775764816.879030:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 4096 00010000:00010000:2.0:1775764816.879038:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879045:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879051:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879057:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.879061:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879068:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879076:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764816.879078:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.879081:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879087:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523971 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764816.879097:0:10681:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003267dad3 reply state 000000000813e1cf transno 4294970662 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879105:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.879119:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x832cc65c (ffff96c1c4135e00) 00010000:00010000:2.0:1775764816.879121:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764816.879123:0:10681:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1775764816.879193:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:48224:x1862023076112384:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 6151us (6323us total) trans 4294970662 rc 0/0 00000100:00100000:2.0:1775764816.879200:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6521 00000100:00100000:1.0:1775764816.901331:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764816.902581:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112640 00000100:00100000:0.0:1775764816.902597:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112640 00000100:00100000:0.0:1775764816.902681:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6522 00000100:00100000:0.0:1775764816.902694:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+36:48225:x1862023076112640:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:0.0:1775764816.902723:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764816.902748:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5395 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.902876:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52398d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.902891:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.902904:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764816.902957:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1775764816.902961:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764816.903002:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.903026:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5395 expref: 38 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.903043:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52398d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5395 expref: 37 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.903056:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764816.903059:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764816.903063:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d000, rc 0) 00000100:00100000:0.0:1775764816.903148:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:48225:x1862023076112640:12345-192.168.202.58@tcp:101:bash.0 Request processed in 457us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764816.903156:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6522 00000100:00100000:3.0:1775764816.907273:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.909253:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112768 00000100:00100000:2.0:1775764816.909268:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112768 00000100:00100000:2.0:1775764816.909344:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6523 00000100:00100000:2.0:1775764816.909355:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:48225:x1862023076112768:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:2.0:1775764816.909381:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764816.909403:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523994 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd539c expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909482:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909498:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909510:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909521:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909528:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909552:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909632:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf600/0x6e98bd47ed5239a9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909640:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf600/0x6e98bd47ed5239a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909647:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf600/0x6e98bd47ed5239a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764816.909683:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 4096 00000004:00200000:2.0:1775764816.909687:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764816.909707:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf600/0x6e98bd47ed5239a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909721:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909727:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909735:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909741:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cee00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.909746:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909753:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909813:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764816.909816:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.909821:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909827:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52399b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909839:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909845:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909850:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909855:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cec00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.909858:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909863:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909870:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x832cc65c (ffff96c1c4135e00) 00010000:00010000:2.0:1775764816.909872:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.909875:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909881:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909930:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523994 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd539c expref: 39 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909943:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf600/0x6e98bd47ed5239a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd539c expref: 38 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.909950:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.909952:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764816.909955:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cf600, rc 0) 00000100:00100000:2.0:1775764816.910033:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:48225:x1862023076112768:12345-192.168.202.58@tcp:101:bash.0 Request processed in 679us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764816.910040:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6523 00000100:00100000:3.0:1775764816.914636:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764816.920047:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076112896 00000100:00100000:1.0:1775764816.920061:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076112896 00000100:00100000:1.0:1775764816.920188:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6524 00000100:00100000:1.0:1775764816.920199:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:48225:x1862023076112896:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:1.0:1775764816.920222:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764816.920243:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5239b0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53a3 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920308:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920322:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920333:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920346:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920352:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920358:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920398:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920405:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920411:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920428:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920434:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.920438:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920446:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920457:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:1.0:1775764816.920471:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.920476:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920483:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239b7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920497:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920503:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920509:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920513:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.920516:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920531:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920539:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:1.0:1775764816.920541:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.920544:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920549:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239be lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920581:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5239b0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53a3 expref: 39 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920591:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:1.0:1775764816.920593:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.920596:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5239b0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53a3 expref: 39 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.920605:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5000, rc 0) 00000100:00100000:1.0:1775764816.920681:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:48225:x1862023076112896:12345-192.168.202.58@tcp:101:bash.0 Request processed in 484us (6053us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764816.920689:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6524 00000100:00100000:3.0:1775764816.937720:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.937795:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113024 00000100:00100000:2.0:1775764816.937806:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113024 00000100:00100000:2.0:1775764816.937869:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6525 00000100:00100000:2.0:1775764816.937880:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+48:48226:x1862023076113024:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764816.937901:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764816.937920:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5239c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53aa expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.937990:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.938005:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.938017:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764816.938075:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1775764816.938079:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764816.938100:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.938124:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5239c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 50 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.938142:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.938152:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764816.938155:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764816.938159:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cec00, rc 0) 00000100:00100000:2.0:1775764816.938484:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+49:48226:x1862023076113024:12345-192.168.202.58@tcp:101:rm.0 Request processed in 605us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764816.938493:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6525 00000100:00100000:3.0:1775764816.943263:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764816.943344:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113152 00000100:00100000:0.0:1775764816.943354:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113152 00000100:00100000:0.0:1775764816.943414:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6526 00000100:00100000:0.0:1775764816.943424:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+49:48226:x1862023076113152:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:0.0:1775764816.943447:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764816.943479:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed5239d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53b1 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943550:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943566:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943580:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943604:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943612:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943619:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943703:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5239e8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943712:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5239e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943719:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5239e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764816.943754:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 4096 00000004:00200000:0.0:1775764816.943798:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764816.943820:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5239e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943832:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943839:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943846:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943862:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764816.943866:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943874:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943888:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764816.943891:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764816.943896:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943902:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed5239da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943915:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943921:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943927:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943932:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764816.943934:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943940:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943958:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x832cc65c (ffff96c1c4135e00) 00010000:00010000:0.0:1775764816.943960:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764816.943963:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943969:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed5239e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.943994:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed5239d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53b1 expref: 51 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.944007:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6dc00/0x6e98bd47ed5239e8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53b1 expref: 50 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764816.944014:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:0.0:1775764816.944017:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1775764816.944019:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6dc00, rc 0) 00000100:00100000:0.0:1775764816.944091:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+50:48226:x1862023076113152:12345-192.168.202.58@tcp:101:rm.0 Request processed in 667us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764816.944099:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6526 00000040:00080000:1.0:1775764816.946282:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764816.946292:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764816.946892:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764816.946904:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764816.948155:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764816.948357:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113280 00000100:00100000:1.0:1775764816.948381:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113280 00000100:00100000:1.0:1775764816.948442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6527 00000100:00100000:1.0:1775764816.948452:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48226:x1862023076113280:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764816.948484:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764816.948505:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5239ef lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53b8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948567:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948582:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948597:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948611:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948618:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948623:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948657:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948664:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948669:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948681:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948687:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.948692:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948699:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948712:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:1.0:1775764816.948715:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.948720:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948727:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed5239f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948740:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948747:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.948754:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949132:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.949136:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949152:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949160:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:1.0:1775764816.949163:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.949166:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949172:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed5239fd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949211:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5239ef lrc: 1/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53b8 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949222:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:1.0:1775764816.949225:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.949228:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed5239ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53b8 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.949237:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5000, rc 0) 00000100:00100000:1.0:1775764816.949534:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48226:x1862023076113280:12345-192.168.202.58@tcp:101:rm.0 Request processed in 1082us (1385us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764816.949544:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6527 00000100:00100000:3.0:1775764816.957504:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.957576:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113408 00000100:00100000:2.0:1775764816.957587:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113408 00000100:00100000:2.0:1775764816.957650:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6528 00000100:00100000:2.0:1775764816.957660:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:48226:x1862023076113408:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764816.957681:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764816.957705:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523a04 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53bf expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957805:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957838:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957851:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957866:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957873:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957880:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957926:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957934:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957941:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957948:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957954:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cee00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.957958:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957966:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.957987:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.957990:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.957995:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 3/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958002:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a0b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958014:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958021:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958027:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958032:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cea00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.958035:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958041:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958049:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c1c4135b00) 00010000:00010000:2.0:1775764816.958051:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.958053:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958060:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a12 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958100:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523a04 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53bf expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958110:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.958112:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.958116:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523a04 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53bf expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.958125:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cf800, rc 0) 00000100:00100000:2.0:1775764816.958742:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:48226:x1862023076113408:12345-192.168.202.58@tcp:101:rm.0 Request processed in 1077us (1243us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764816.958752:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6528 00000100:00100000:3.0:1775764816.979052:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.979275:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113536 00000100:00100000:2.0:1775764816.979285:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113536 00000100:00100000:2.0:1775764816.979359:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6529 00000100:00100000:2.0:1775764816.979370:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+50:48227:x1862023076113536:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764816.979390:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764816.979412:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523a19 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53c6 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979499:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979513:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979524:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979548:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979556:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979563:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979596:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979603:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979610:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979616:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cea00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.979619:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979627:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979638:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.979641:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.979645:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979651:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed523a20 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979670:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979677:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979683:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979688:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cee00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.979691:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979697:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979704:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c1c4135b00) 00010000:00010000:2.0:1775764816.979707:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.979709:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979715:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed523a27 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.979747:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523a19 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53c6 expref: 51 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.980200:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.980204:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.980217:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed523a19 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53c6 expref: 51 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.980229:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cf800, rc 0) 00000100:00100000:2.0:1775764816.980298:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+50:48227:x1862023076113536:12345-192.168.202.58@tcp:101:cp.0 Request processed in 930us (1256us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764816.980307:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6529 00000100:00100000:1.0:1775764816.984112:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.984202:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113664 00000100:00100000:2.0:1775764816.984213:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113664 00000100:00100000:2.0:1775764816.984278:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6530 00000100:00100000:2.0:1775764816.984289:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+50:48227:x1862023076113664:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764816.984310:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764816.984344:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed523a2e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53cd expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984411:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984426:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984439:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984453:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984469:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984478:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984534:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984541:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984548:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984555:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.984559:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984567:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984580:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.984584:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.984588:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984594:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a35 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984608:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984615:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984621:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984632:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764816.984635:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984642:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984649:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c1c4135a00) 00010000:00010000:2.0:1775764816.984652:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.984654:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984660:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a3c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984692:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed523a2e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53cd expref: 51 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984701:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764816.984704:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764816.984707:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed523a2e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53cd expref: 51 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.984717:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cfe00, rc 0) 00000100:00100000:2.0:1775764816.985128:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+50:48227:x1862023076113664:12345-192.168.202.58@tcp:101:cp.0 Request processed in 839us (1024us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764816.985136:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6530 00000100:00100000:3.0:1775764816.989306:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764816.990494:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076113920 00000100:00100000:1.0:1775764816.990507:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076113920 00000100:00100000:1.0:1775764816.990614:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6531 00000100:00100000:1.0:1775764816.990625:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48227:x1862023076113920:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:1.0:1775764816.990664:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764816.990689:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523a43 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53d4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.990828:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.990845:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.990856:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.990869:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.990875:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.990881:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764816.991174:0:6522:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x56:0x0], index 1: 0 00010000:00010000:1.0:1775764816.991640:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991651:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991659:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991706:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991714:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991720:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991727:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991733:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764816.991738:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991745:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.991985:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:1.0:1775764816.991989:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764816.991994:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 3/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.992001:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523a4a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764816.992015:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004cafe1ab reply state 00000000fe8611f4 transno 4294970663 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.992027:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.992039:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:1.0:1775764816.992042:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764816.992045:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764816.992078:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523a43 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.992092:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764816.992101:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764816.992103:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764816.992106:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5c00, rc 0) 00000100:00100000:1.0:1775764816.992299:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+53:48227:x1862023076113920:12345-192.168.202.58@tcp:101:cp.0 Request processed in 1675us (3002us total) trans 4294970663 rc 0/0 00000100:00100000:1.0:1775764816.992308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6531 00000100:00100000:3.0:1775764816.997237:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764816.998014:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114048 00000100:00100000:2.0:1775764816.998037:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114048 00000100:00100000:2.0:1775764816.998143:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1719 00000100:00100000:2.0:1775764816.998153:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076114048:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764816.998171:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764816.998199:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53db expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764816.998225:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1775764816.998243:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764816.998246:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764816.998255:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.998272:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764816.998287:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2c00, rc 0) 00000100:00100000:2.0:1775764816.998557:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076114048:12345-192.168.202.58@tcp:101:cp.0 Request processed in 404us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764816.998565:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1719 00000100:00100000:3.0:1775764817.002234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00080000:0.0:1775764817.002583:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764817.002674:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114176 00000100:00100000:1.0:1775764817.002685:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114176 00000100:00100000:1.0:1775764817.002797:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1720 00000100:00100000:1.0:1775764817.002807:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:48227:x1862023076114176:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:1.0:1775764817.002825:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764817.002844:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53e2 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764817.002874:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764817.002899:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764817.002901:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764817.002904:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764817.002938:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764817.002949:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 1424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764817.002961:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099812608:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764817.003043:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d55b50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764817.005839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764817.005952:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099812608:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764817.005983:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764817.006003:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4a00, rc 0) 00000100:00100000:1.0:1775764817.006068:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+9:48227:x1862023076114176:12345-192.168.202.58@tcp:101:cp.0 Request processed in 3262us (3845us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764817.006078:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1720 00000100:00100000:2.0:1775764817.006502:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114304 00000100:00100000:2.0:1775764817.006510:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114304 00010000:00010000:2.0:1775764817.006540:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 1424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764817.006569:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1411 00000100:00100000:2.0:1775764817.006577:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076114304:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764817.006606:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764817.006628:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 1424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.006643:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 1424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.006667:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523a66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53db expref: 9 pid: 15167 timeout: 1424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.006681:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764817.006683:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764817.006691:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 8 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.006701:0:6506:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 8 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.006733:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 8 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764817.006748:0:6506:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c55b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1862023099812736:192.168.202.58@tcp:105: 00000100:00100000:2.0:1775764817.006830:0:6506:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c7149180 going to sleep for 11 seconds 00000100:00100000:2.0:1775764817.012567:0:6506:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c55b2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1862023099812736:192.168.202.58@tcp:105: 00010000:00010000:2.0:1775764817.012609:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764817.012681:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076114304:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 6104us (6851us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764817.012693:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1411 00000100:00100000:3.0:1775764817.013902:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764817.015262:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114560 00000100:00100000:0.0:1775764817.015275:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114560 00000100:00100000:1.0:1775764817.016269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1370 00000100:00100000:1.0:1775764817.016282:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+53:48227:x1862023076114560:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:1.0:1775764817.017555:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:48227:x1862023076114560:12345-192.168.202.58@tcp:35:cp.0 Request processed in 1266us (3650us total) trans 4294970664 rc 0/0 00000100:00100000:1.0:1775764817.017566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1370 00000100:00100000:3.0:1775764817.065828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764817.066151:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114688 00000100:00100000:2.0:1775764817.066162:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114688 00000100:00100000:2.0:1775764817.066236:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6532 00000100:00100000:2.0:1775764817.066246:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:48230:x1862023076114688:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764817.066267:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764817.066289:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a74 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53e9 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066371:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066385:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066397:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066408:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066414:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066421:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066511:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066538:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066545:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764817.066583:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9d:0x0]: returning size 1516 00000004:00200000:2.0:1775764817.066588:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764817.066607:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066618:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066627:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066634:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066640:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066646:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066652:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764817.066656:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066663:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066682:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764817.066685:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764817.066690:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 3/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066696:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523a7b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066709:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066716:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066721:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066727:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764817.066730:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066736:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066742:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:2.0:1775764817.066745:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764817.066747:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066753:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a82 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066848:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a74 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 40 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066862:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 39 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.066869:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:2.0:1775764817.066871:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764817.066874:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3000, rc 0) 00000100:00100000:2.0:1775764817.066941:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:48230:x1862023076114688:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 697us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764817.066949:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6532 00000100:00100000:3.0:1775764817.072738:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764817.072921:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114816 00000100:00100000:0.0:1775764817.072931:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114816 00000100:00100000:0.0:1775764817.073012:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1721 00000100:00100000:0.0:1775764817.073022:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076114816:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764817.073039:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764817.073070:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed523a90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53f0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764817.073133:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099812864:192.168.202.58@tcp:106: 00000100:00100000:0.0:1775764817.073228:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c6205d80 going to sleep for 11 seconds 00000100:00080000:2.0:1775764817.073284:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1775764817.077581:0:8405:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1775764817.077591:0:8405:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb mtime: 0 -> 1775764816 00002000:00010000:0.0:1775764817.077593:0:8405:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb atime: 0 -> 1775764816 00002000:00010000:0.0:1775764817.077596:0:8405:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb ctime: 0 -> 1775764816 00002000:00010000:0.0:1775764817.077598:0:8405:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1775764817.077620:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099812864:192.168.202.58@tcp:106: 00010000:00010000:0.0:1775764817.077663:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed523a90 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53f0 expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764817.077692:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed523a90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53f0 expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764817.077707:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c400, rc 0) 00000100:00100000:0.0:1775764817.077944:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076114816:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 4922us (5215us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764817.077954:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1721 00000100:00100000:3.0:1775764817.082722:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764817.082824:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076114944 00000100:00100000:2.0:1775764817.082835:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076114944 00000100:00100000:2.0:1775764817.082892:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6533 00000100:00100000:2.0:1775764817.082903:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:48230:x1862023076114944:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764817.082924:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764817.082947:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53f7 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.083016:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a9e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.083031:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a9e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.083060:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a9e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764817.083103:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 4096 00000004:00200000:2.0:1775764817.083107:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764817.083127:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a9e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.083154:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53f7 expref: 41 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.083172:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3200/0x6e98bd47ed523a9e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53f7 expref: 40 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.083195:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764817.083197:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764817.083201:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3200, rc 0) 00000100:00100000:2.0:1775764817.084027:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:48230:x1862023076114944:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1120us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764817.084037:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6533 00000100:00100000:3.0:1775764817.092327:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764817.092499:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076115072 00000100:00100000:2.0:1775764817.092511:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076115072 00000100:00100000:2.0:1775764817.092573:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1722 00000100:00100000:2.0:1775764817.092583:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076115072:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764817.092602:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764817.092622:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3132f66/0x6e98bd47ed523aa5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd53fe expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764817.092707:0:15167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c55b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099812992:192.168.202.58@tcp:106: 00000100:00100000:2.0:1775764817.092817:0:15167:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c7149180 going to sleep for 11 seconds 00000100:00100000:2.0:1775764817.095679:0:15167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c55b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099812992:192.168.202.58@tcp:106: 00010000:00010000:2.0:1775764817.095736:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3132f66/0x6e98bd47ed523aa5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53fe expref: 10 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.095816:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3132f66/0x6e98bd47ed523aa5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53fe expref: 10 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764817.095831:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3600, rc 0) 00000100:00100000:2.0:1775764817.095898:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076115072:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 3315us (3580us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764817.095908:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1722 00000100:00100000:0.0:1775764817.101250:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764817.101340:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076115328 00000100:00100000:3.0:1775764817.101352:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076115328 00000100:00100000:3.0:1775764817.101414:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6534 00000100:00100000:3.0:1775764817.101425:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:48230:x1862023076115328:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:3.0:1775764817.101625:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].150, 136 off28384 00000100:00100000:3.0:1775764817.101714:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:48230:x1862023076115328:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 291us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764817.101723:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6534 00000100:00100000:0.0:1775764817.714575:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099813120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764817.714665:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764817.714830:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099813120 00000100:00100000:1.0:1775764817.714841:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099813120 00000100:00100000:1.0:1775764817.714911:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1775764817.714921:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099813120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764817.714959:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764817.715013:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099813120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764817.715022:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00080000:1.0:1775764817.715045:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764817.715153:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099813120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764817.715181:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764817.715196:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099813248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764817.715223:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764817.715249:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099813248 00000100:00100000:0.0:1775764817.715253:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099813248 00000100:00100000:0.0:1775764817.715285:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1775764817.715292:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099813248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1775764817.715302:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:0.0:1775764817.715345:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099813248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764817.715351:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1775764817.715380:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099813248:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1775764817.715393:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1775764817.778430:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764817.778440:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:1.0:1775764817.778979:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764817.779639:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1775764817.779655:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1775764817.971845:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764817.971855:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764817.971882:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 151 count 2 00000040:00080000:1.0:1775764817.971894:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764817.972138:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099813376:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764817.972259:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2f732c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764817.996683:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764817.996725:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076115456 00000100:00100000:1.0:1775764817.996735:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076115456 00000100:00100000:1.0:1775764817.996819:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6535 00000100:00100000:1.0:1775764817.996830:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076115456:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764817.996870:0:6522:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9d:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764817.996994:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076115456:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 166us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764817.997010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6535 00000100:00100000:1.0:1775764817.997209:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099813376:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764818.007681:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764818.007731:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076115712 00000100:00100000:2.0:1775764818.007793:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076115712 00000100:00100000:2.0:1775764818.007867:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6536 00000100:00100000:2.0:1775764818.007879:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+54:48240:x1862023076115712:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764818.007903:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764818.007929:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523aac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5405 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.008047:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523ab3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.008077:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.008091:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764818.008106:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9d:0x0]: returning size 1516 00010000:00010000:2.0:1775764818.010063:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523aac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5405 expref: 57 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775764818.022105:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1775764818.027843:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5405 expref: 56 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.027861:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:2.0:1775764818.027864:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764818.027868:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2e00, rc 0) 00000100:00100000:2.0:1775764818.027952:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076115712:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 20075us (20283us total) trans 4294970665 rc 0/0 00000100:00100000:2.0:1775764818.027962:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6536 00000100:00100000:1.0:1775764818.037034:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764818.037110:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764818.037160:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076115968 00000100:00100000:1.0:1775764818.037180:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076115968 00000100:00100000:1.0:1775764818.037244:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 751 00000100:00100000:1.0:1775764818.037256:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:2409:x1862023076115968:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764818.037273:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764818.037300:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523ab3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5405 expref: 56 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764818.037322:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764818.037327:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764818.037383:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:2409:x1862023076115968:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 129us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764818.037390:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 751 00000100:00100000:3.0:1775764818.037731:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076115840 00000100:00100000:3.0:1775764818.037736:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076115840 00000100:00100000:3.0:1775764818.037814:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1723 00000100:00100000:3.0:1775764818.037822:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076115840:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764818.037859:0:24969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.037877:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 8 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.037885:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764818.037887:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764818.037890:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.037923:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 8 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.037937:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 8 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764818.037959:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099813504:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764818.038021:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0ae40 going to sleep for 11 seconds 00000100:00080000:1.0:1775764818.039324:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764818.067729:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764818.067921:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099813504:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764818.067948:0:24969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764818.068674:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076116096 00000100:00100000:1.0:1775764818.068683:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076116096 00002000:00100000:1.0:1775764818.068731:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x56:0x0] (0->1515) req@ffff96c1c72e4a80 x1862023076116096/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:299/0 lens 2008/0 e 0 to 0 dl 1775764829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764818.068742:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c72e4a80 with x1862023076116096 ext(0->1515) 00010000:00010000:1.0:1775764818.070697:0:8409:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 9 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764818.070743:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 9 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764818.070856:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c1c72e4a80 00000100:00100000:1.0:1775764818.072108:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 33 00000100:00100000:1.0:1775764818.072139:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076116096:12345-192.168.202.58@tcp:4:cp.0 00000100:00100000:1.0:1775764818.073684:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+11:2410:x1862023076116096:12345-192.168.202.58@tcp:4:cp.0 Request processed in 1558us (5958us total) trans 4294967726 rc 0/0 00000100:00100000:1.0:1775764818.073695:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 33 00002000:00100000:1.0:1775764818.073707:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x56:0x0] (0->1515) req@ffff96c1c72e4a80 x1862023076116096/t4294967726(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:299/0 lens 2008/448 e 0 to 0 dl 1775764829 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764818.073717:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c72e4a80 with x1862023076116096 ext(0->1515) 00010000:00010000:1.0:1775764818.073726:0:8409:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 11 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764818.073743:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 11 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764818.073762:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c1c72e4a80 00000100:00100000:3.0:1775764818.095006:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764818.095592:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076116224 00000100:00100000:2.0:1775764818.095604:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076116224 00010000:00010000:2.0:1775764818.095646:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 11 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764818.095718:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1412 00000100:00100000:2.0:1775764818.095725:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+11:2408:x1862023076116224:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764818.095739:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1775764818.095782:0:25200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x56:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:2.0:1775764818.095791:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 11 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.095808:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 11 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.095835:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477caefa/0x6e98bd47ed523a6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e2 expref: 11 pid: 8641 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.095850:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764818.095853:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764818.095858:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.095868:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.095902:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764818.095957:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+10:2408:x1862023076116224:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 232us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764818.095965:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1412 00010000:00010000:3.0:1775764818.105697:0:24969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105714:0:24969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105742:0:24969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105749:0:24969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105755:0:24969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105759:0:24969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764818.105762:0:24969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105767:0:24969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105796:0:24969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.105821:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523ac1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764818.105907:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076115840:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 68083us (68880us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764818.105916:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1723 00000100:00100000:2.0:1775764818.127692:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764818.131269:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076116480 00000100:00100000:3.0:1775764818.131286:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076116480 00000100:00100000:3.0:1775764818.131361:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6537 00000100:00100000:3.0:1775764818.131371:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076116480:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764818.131503:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076116480:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 133us (3820us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764818.131511:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6537 00000100:00100000:3.0:1775764818.139652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764818.139761:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076116608 00000100:00100000:2.0:1775764818.139802:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076116608 00000100:00100000:2.0:1775764818.139858:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1724 00000100:00100000:2.0:1775764818.139867:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2409:x1862023076116608:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764818.139897:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764818.139917:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd540c expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764818.139943:0:8403:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x56:0x0] initial LVB size: 1516, mtime: 0x69d80550, atime: 0x0, ctime: 0x69d80550, blocks: 0x8 00010000:00010000:2.0:1775764818.139963:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764818.139965:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764818.139973:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.139990:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.140004:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3800, rc 0) 00000100:00100000:2.0:1775764818.140068:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2409:x1862023076116608:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 201us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764818.140075:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1724 00000100:00100000:3.0:1775764818.146832:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764818.146924:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076116864 00000100:00100000:0.0:1775764818.146934:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076116864 00000100:00100000:0.0:1775764818.147005:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6538 00000100:00100000:0.0:1775764818.147015:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076116864:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764818.147155:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076116864:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 140us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764818.147163:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6538 00000100:00100000:3.0:1775764818.156764:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764818.157174:0:25201:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076116992 00000100:00100000:2.0:1775764818.157185:0:25201:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076116992 00002000:00100000:2.0:1775764818.157236:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x56:0x0] (0->4095) req@ffff96c1c2eb7100 x1862023076116992/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:299/0 lens 488/0 e 0 to 0 dl 1775764829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764818.157249:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2eb7100 with x1862023076116992 ext(0->4095) 00002000:00010000:2.0:1775764818.157256:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c2eb7100 00000100:00100000:2.0:1775764818.157288:0:25201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 435 00000100:00100000:2.0:1775764818.157297:0:25201:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076116992:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1775764818.157506:0:25201:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076116992:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 209us (761us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1775764818.157514:0:25201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 435 00002000:00100000:2.0:1775764818.157521:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x56:0x0] (0->4095) req@ffff96c1c2eb7100 x1862023076116992/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:299/0 lens 488/4536 e 0 to 0 dl 1775764829 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1775764818.157529:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2eb7100 with x1862023076116992 ext(0->4095) 00002000:00010000:2.0:1775764818.157532:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c2eb7100 00000100:00100000:3.0:1775764818.173637:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764818.173678:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076117120 00000100:00100000:3.0:1775764818.173689:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076117120 00000100:00100000:3.0:1775764818.173740:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6539 00000100:00100000:3.0:1775764818.173749:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:48240:x1862023076117120:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764818.173790:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764818.173810:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523acf lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5413 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.173862:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.173877:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.173888:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.173992:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523acf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 57 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.174011:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.174020:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:3.0:1775764818.174023:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764818.174027:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9000, rc 0) 00000100:00100000:3.0:1775764818.174096:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076117120:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 347us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764818.174103:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6539 00000100:00100000:2.0:1775764818.180660:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764818.180743:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076117248 00000100:00100000:0.0:1775764818.180753:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076117248 00000100:00100000:0.0:1775764818.180836:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6540 00000100:00100000:0.0:1775764818.180848:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076117248:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1775764818.180882:0:10088:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1775764818.180992:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076117248:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764818.181013:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6540 00000100:00100000:0.0:1775764818.185796:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764818.185835:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076117376 00000100:00100000:0.0:1775764818.185845:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076117376 00000100:00100000:0.0:1775764818.185896:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1725 00000100:00100000:0.0:1775764818.185906:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076117376:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1775764818.185951:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.185968:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764818.185970:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764818.185975:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.185991:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186016:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186024:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186032:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186058:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d800 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764818.186062:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186072:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186088:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764818.186094:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed523add lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764818.186176:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076117376:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 271us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764818.186183:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1725 00000040:00080000:1.0:1775764818.191344:0:30664:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764818.191352:0:30664:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764818.191380:0:30664:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 151 count 2 00000040:00080000:1.0:1775764818.191386:0:30664:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764818.193342:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764818.193589:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076117632 00000100:00100000:3.0:1775764818.193600:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076117632 00000100:00100000:3.0:1775764818.193659:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6541 00000100:00100000:3.0:1775764818.193669:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076117632:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764818.193749:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.193813:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.193822:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.193857:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.193871:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 56 pid: 24980 timeout: 1426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764818.193886:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099813632:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764818.193996:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1775764818.196709:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764818.196740:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076117760 00000100:00100000:2.0:1775764818.196749:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076117760 00010000:00010000:2.0:1775764818.196804:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 57 pid: 24980 timeout: 1426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764818.196840:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1413 00000100:00100000:2.0:1775764818.196849:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:2411:x1862023076117760:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764818.196866:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764818.196874:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 57 pid: 24980 timeout: 1426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.196889:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 57 pid: 24980 timeout: 1426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.196915:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:2.0:1775764818.196929:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.196939:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.196947:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764818.196966:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764818.197017:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:2411:x1862023076117760:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 168us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764818.197025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1413 00010000:00010000:3.0:1775764818.197664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523ad6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5413 expref: 56 pid: 24980 timeout: 1426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764818.197681:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099813632:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764818.197701:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197710:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197715:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197904:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197920:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197927:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197933:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764818.197937:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197944:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197955:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:3.0:1775764818.197958:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764818.197961:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764818.197966:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ae4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764818.198070:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076117632:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 4402us (4738us total) trans 4294970666 rc 0/0 00000100:00100000:3.0:1775764818.198078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6541 00000040:00080000:3.0:1775764818.200159:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764818.201272:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764818.201924:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1775764818.201936:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764818.204901:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764818.205252:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118016 00000100:00100000:3.0:1775764818.205264:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118016 00000100:00100000:3.0:1775764818.205324:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1371 00000100:00100000:3.0:1775764818.205334:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:48240:x1862023076118016:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764818.205659:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+57:48240:x1862023076118016:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 325us (766us total) trans 4294970667 rc 0/0 00000100:00100000:3.0:1775764818.205668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1371 00000100:00100000:2.0:1775764818.743519:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764818.743542:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099813760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1775764818.743624:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764818.744011:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099813760 00000100:00100000:3.0:1775764818.744020:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099813760 00000100:00100000:3.0:1775764818.744081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1775764818.744092:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099813760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764818.744130:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764818.744204:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099813760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764818.744212:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1775764818.744751:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099813760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764818.802513:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764819.074351:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074388:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074416:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074454:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074484:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074504:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074520:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074548:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764819.074581:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118528 00000100:00100000:2.0:1775764819.074607:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118528 00000100:00100000:2.0:1775764819.074682:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118656 00000100:00100000:2.0:1775764819.074686:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118656 00000100:00100000:1.0:1775764819.074705:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118272 00000100:00100000:2.0:1775764819.074705:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119040 00000100:00100000:2.0:1775764819.074708:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119040 00000100:00100000:1.0:1775764819.074714:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118272 00000100:00100000:2.0:1775764819.074727:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1395 00000100:00100000:1.0:1775764819.074737:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118400 00000100:00100000:2.0:1775764819.074737:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076118528:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764819.074739:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118400 00000100:00100000:1.0:1775764819.074757:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118784 00000100:00100000:1.0:1775764819.074759:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118784 00000100:00100000:1.0:1775764819.074807:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118912 00000100:00100000:1.0:1775764819.074811:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118912 00000100:00100000:1.0:1775764819.074826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1915 00000100:00100000:1.0:1775764819.074832:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:2408:x1862023076118272:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764819.074909:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:2408:x1862023076118272:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 75us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.074928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1915 00000100:00100000:1.0:1775764819.074944:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1916 00000100:00100000:1.0:1775764819.074951:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076118400:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764819.074976:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076118400:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.074981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1916 00000100:00100000:1.0:1775764819.074991:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1917 00000100:00100000:1.0:1775764819.074997:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:2408:x1862023076118784:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764819.075021:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:2408:x1862023076118784:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.075027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1917 00000100:00100000:1.0:1775764819.075038:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1918 00000100:00100000:1.0:1775764819.075044:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076118912:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764819.075063:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076118912:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.075065:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+5:2408:x1862023076118528:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 330us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.075072:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1395 00000100:00100000:1.0:1775764819.075074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1918 00000100:00100000:2.0:1775764819.075085:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1396 00000100:00080000:1.0:1775764819.075090:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764819.075091:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+10:2408:x1862023076118656:12345-192.168.202.58@tcp:400:kworker.0 00000100:00080000:1.0:1775764819.075094:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1775764819.075096:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764819.075112:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+10:2408:x1862023076118656:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.075118:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1396 00000100:00100000:1.0:1775764819.075123:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1397 00000100:00100000:1.0:1775764819.075129:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076119040:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764819.075154:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2408:x1862023076119040:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.075159:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1397 00000100:00100000:0.0:1775764819.075352:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076118144 00000100:00100000:0.0:1775764819.075358:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076118144 00000100:00100000:0.0:1775764819.075407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 967 00000100:00100000:0.0:1775764819.075414:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076118144:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764819.075463:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076118144:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 49us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764819.075469:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 967 00000100:00100000:3.0:1775764819.076117:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764819.076373:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119168 00000100:00100000:0.0:1775764819.076379:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119168 00000100:00100000:0.0:1775764819.076427:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1398 00000100:00100000:0.0:1775764819.076434:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076119168:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764819.076496:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076119168:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 63us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764819.076504:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1398 00000100:00080000:3.0:1775764819.078311:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764819.252192:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099814144:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252267:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764819.252329:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099814656:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252357:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764819.252379:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099815168:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252402:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764819.252428:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1775764819.252433:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099814016:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252467:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764819.252486:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099814528:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252544:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764819.252563:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099815040:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252585:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764819.252619:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814144 00000100:00100000:2.0:1775764819.252628:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814144 00000100:00100000:2.0:1775764819.252675:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1775764819.252684:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099814144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252743:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099814144:12345-0@lo:400:kworker.0 Request processed in 60us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.252762:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1775764819.252812:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814656 00000100:00100000:2.0:1775764819.252816:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814656 00000100:00100000:2.0:1775764819.252848:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099815168 00000100:00100000:2.0:1775764819.252850:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099815168 00000100:00100000:2.0:1775764819.252864:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814016 00000100:00100000:2.0:1775764819.252866:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814016 00000100:00100000:2.0:1775764819.252876:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814528 00000100:00100000:2.0:1775764819.252878:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814528 00000100:00100000:2.0:1775764819.252889:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099815040 00000100:00100000:2.0:1775764819.252891:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099815040 00000100:00100000:2.0:1775764819.252902:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1775764819.252908:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099814656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252937:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099814656:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.252943:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1775764819.252955:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1775764819.252960:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099815168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.252981:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099815168:12345-0@lo:400:kworker.0 Request processed in 22us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.252992:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1775764819.253004:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1775764819.253009:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099814016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253030:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099814016:12345-0@lo:400:kworker.0 Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.253035:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1775764819.253044:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1775764819.253048:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099814528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253067:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099814528:12345-0@lo:400:kworker.0 Request processed in 19us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.253072:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1775764819.253080:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1775764819.253085:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253102:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099815040:12345-0@lo:400:kworker.0 Request processed in 18us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.253108:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1775764819.253151:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099814016:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253160:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099814528:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253167:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099815040:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253175:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099814144:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253182:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099814656:0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.253189:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099815168:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253560:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099813888:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253601:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253635:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099814400:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253654:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253667:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099814912:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253685:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253696:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099815424:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253711:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253724:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775764819.253729:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099814272:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253754:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253794:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099814784:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253813:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253826:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099815296:0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253841:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.253860:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814272 00000100:00100000:0.0:1775764819.253864:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814272 00000100:00100000:0.0:1775764819.253890:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1775764819.253902:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099814272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764819.253943:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099814272:12345-0@lo:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764819.253949:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1775764819.253979:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099814272:0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254095:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814912 00000100:00100000:1.0:1775764819.254098:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814912 00000100:00100000:1.0:1775764819.254130:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099815424 00000100:00100000:1.0:1775764819.254132:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099815424 00000100:00100000:1.0:1775764819.254147:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814784 00000100:00100000:1.0:1775764819.254149:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814784 00000100:00100000:1.0:1775764819.254168:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099815296 00000100:00100000:1.0:1775764819.254170:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099815296 00000100:00100000:1.0:1775764819.254180:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1775764819.254186:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099814912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254219:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099814912:12345-0@lo:400:kworker.0 Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.254224:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1775764819.254234:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1775764819.254238:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099815424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254257:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099815424:12345-0@lo:400:kworker.0 Request processed in 19us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.254262:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1775764819.254277:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1775764819.254281:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099814784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254302:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099814784:12345-0@lo:400:kworker.0 Request processed in 21us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.254307:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1775764819.254316:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1775764819.254321:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099815296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254343:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099815296:12345-0@lo:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.254348:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1775764819.254367:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099814400 00000100:00100000:1.0:1775764819.254370:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099814400 00000100:00100000:1.0:1775764819.254393:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1775764819.254398:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099814400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254429:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099814400:12345-0@lo:400:kworker.0 Request processed in 32us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.254434:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1775764819.254482:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099814784:0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254491:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099815296:0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254499:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099814400:0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254507:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099814912:0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.254514:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099815424:0@lo:400:kworker.0 00000100:00080000:3.0:1775764819.254824:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764819.254830:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764819.254832:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764819.254835:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764819.259550:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099813888 00000100:00100000:2.0:1775764819.259566:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099813888 00000100:00100000:2.0:1775764819.259644:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1775764819.259656:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099813888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764819.259747:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099813888:12345-0@lo:400:kworker.0 Request processed in 94us (6145us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764819.259754:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1775764819.261667:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099813888:0@lo:400:kworker.0 00000100:00100000:1.0:1775764819.768391:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099815552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764819.768479:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764819.768572:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099815552 00000100:00100000:1.0:1775764819.768581:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099815552 00000100:00100000:1.0:1775764819.768631:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1775764819.768640:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099815552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764819.768682:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510189760 pending 28672 free 3886534656 avail 3655012352 00000100:00100000:1.0:1775764819.768731:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099815552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764819.768738:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1775764819.768804:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099815552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764819.769379:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764819.769389:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099815680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764819.769424:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764819.769508:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099815680 00000100:00100000:0.0:1775764819.769514:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099815680 00000100:00100000:0.0:1775764819.769556:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1775764819.769564:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099815680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1775764819.769582:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510189760 pending 28672 free 3886534656 avail 3655012352 00000100:00100000:0.0:1775764819.769621:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099815680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764819.769628:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1775764819.769707:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099815680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1775764819.825999:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764820.145591:0:30715:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764820.145601:0:30715:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764820.145734:0:30715:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 151 count 2 00000040:00080000:3.0:1775764820.145743:0:30715:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764820.228270:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764820.228462:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119296 00000100:00100000:2.0:1775764820.228473:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119296 00000100:00100000:2.0:1775764820.228539:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1726 00000100:00100000:2.0:1775764820.228550:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076119296:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764820.228570:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764820.228589:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd541a expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.228616:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764820.228619:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764820.228628:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.228645:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.228660:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2e00, rc 0) 00000100:00100000:2.0:1775764820.228741:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2408:x1862023076119296:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 193us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764820.228765:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1726 00000100:00100000:0.0:1775764820.243204:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764820.243247:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119552 00000100:00100000:0.0:1775764820.243258:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119552 00000100:00100000:0.0:1775764820.243315:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6542 00000100:00100000:0.0:1775764820.243325:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:48249:x1862023076119552:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764820.243350:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764820.243373:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523af2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5421 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.243506:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523af9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.243524:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523af9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.243548:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523af9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764820.243567:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9d:0x0]: returning size 1516 00010000:00010000:0.0:1775764820.243715:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523af2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5421 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.243736:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523af9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5421 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.243745:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:0.0:1775764820.243748:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1775764820.243752:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c400, rc 0) 00000100:00100000:0.0:1775764820.243831:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48249:x1862023076119552:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 507us (639us total) trans 4294970668 rc 0/0 00000100:00100000:0.0:1775764820.243839:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6542 00000100:00100000:3.0:1775764820.249350:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764820.249401:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119680 00000100:00100000:2.0:1775764820.249412:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119680 00000100:00100000:2.0:1775764820.249488:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1727 00000100:00100000:2.0:1775764820.249499:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076119680:12345-192.168.202.58@tcp:1:lfs.0 00010000:00010000:2.0:1775764820.249545:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.249569:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.249579:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.249587:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764820.249590:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764820.249594:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.249632:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.249646:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 10 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764820.249663:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099815808:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764820.249968:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.249979:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 9 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764820.249990:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099815936:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764820.250017:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7900 going to sleep for 11 seconds 00000100:00100000:3.0:1775764820.255342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764820.255373:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764820.255417:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119808 00000100:00100000:3.0:1775764820.255417:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076119936 00000100:00100000:0.0:1775764820.255427:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119808 00000100:00100000:3.0:1775764820.255427:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076119936 00010000:00010000:0.0:1775764820.255492:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 11 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.255492:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 10 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764820.255514:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099815808:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764820.255531:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099815936:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764820.255539:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1414 00000100:00100000:3.0:1775764820.255545:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1415 00000100:00100000:0.0:1775764820.255550:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2411:x1862023076119808:12345-192.168.202.58@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1775764820.255551:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076119936:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764820.255568:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.255571:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764820.255571:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764820.255599:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 11 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.255599:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 10 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.255624:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 10 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.255637:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 11 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.257333:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523ac8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd540c expref: 10 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.257359:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764820.257398:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010cbdb3f/0x6e98bd47ed523aeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd541a expref: 11 pid: 8403 timeout: 1428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.257412:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764820.257415:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764820.257420:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.257429:0:25199:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764820.257442:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076119936:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 1879us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764820.257455:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1415 00000100:00080000:3.0:1775764820.257493:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1775764820.257888:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764820.258007:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076119808:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 2457us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764820.258016:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1414 00010000:00010000:2.0:1775764820.258311:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258324:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258355:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258361:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258380:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258387:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764820.258391:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258399:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258412:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.258419:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523b07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764820.258488:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076119680:12345-192.168.202.58@tcp:1:lfs.0 Request processed in 8990us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764820.258498:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1727 00000100:00100000:2.0:1775764820.262489:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764820.262548:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076120192 00000100:00100000:3.0:1775764820.262564:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076120192 00000100:00100000:3.0:1775764820.262745:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1372 00000100:00100000:3.0:1775764820.262758:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48249:x1862023076120192:12345-192.168.202.58@tcp:35:lfs.0 00000004:00010000:3.0:1775764820.263156:0:6525:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x200000403:0x9d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523af9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5421 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1775764820.263567:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970669 00000001:00080000:0.0:1775764820.265395:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970670 00010000:00010000:0.0:1775764820.265478:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.265499:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.265508:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.265524:0:6525:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 5/0,1 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.265572:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.265589:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 45 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764820.265609:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099816064:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764820.265736:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764820.265748:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 56 pid: 6522 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764820.265757:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099816192:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764820.265915:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8838e40 going to sleep for 11 seconds 00000100:00100000:2.0:1775764820.274967:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099816064:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764820.274989:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1862023099816192:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764820.275047:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764820.280221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764820.280276:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764820.281867:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076120448 00000100:00100000:1.0:1775764820.281880:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076120448 00010000:00010000:1.0:1775764820.281947:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 57 pid: 6522 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764820.281983:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076120320 00000100:00100000:1.0:1775764820.281985:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076120320 00010000:00010000:1.0:1775764820.281997:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 46 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764820.282013:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1416 00000100:00100000:1.0:1775764820.282029:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+57:2411:x1862023076120448:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764820.282045:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764820.282051:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 57 pid: 6522 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282062:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 57 pid: 6522 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282083:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523a58 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53d4 expref: 57 pid: 6522 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282305:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764820.282311:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282320:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282326:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764820.282402:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076120448:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 373us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764820.282409:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1416 00000100:00100000:1.0:1775764820.282426:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1417 00000100:00100000:1.0:1775764820.282451:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:2411:x1862023076120320:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764820.282458:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764820.282463:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 46 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282481:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 46 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282492:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523a89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53e9 expref: 46 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282501:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764820.282504:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282510:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282517:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282540:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764820.282562:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2411:x1862023076120320:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 130us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764820.282569:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1417 00010000:00010000:1.0:1775764820.282733:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.282742:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775764820.283050:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1775764820.285144:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970671 00000001:00080000:1.0:1775764820.285484:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970672 00000100:00100000:1.0:1775764820.285587:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099816320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1775764820.285675:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764820.285721:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2f732cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1775764820.285917:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099816320 00000100:00100000:3.0:1775764820.285926:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099816320 00000100:00100000:3.0:1775764820.285989:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1775764820.285998:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099816320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1775764820.286095:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099816320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764820.286103:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1775764820.286933:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099816320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1775764820.287072:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970673 00000100:00100000:1.0:1775764820.287159:0:6525:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099816448:0@lo:1000:mdt_rdpg00_001.0 00000020:00080000:2.0:1775764820.287943:0:7436:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 53 batchid updated 00000100:00100000:1.0:1775764820.287983:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1775764820.288003:0:7457:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 53 00000100:00100000:1.0:1775764820.288020:0:6525:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c3f22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1775764820.288045:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099816448 00000100:00100000:1.0:1775764820.288053:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099816448 00000004:00080000:3.0:1775764820.288068:0:7457:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96c1c45cd3c0 with version 9 00000020:00080000:3.0:1775764820.288083:0:7457:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 53 cancel update log [0x200000401:0x2:0x0].3: rc = 0 00000020:00080000:3.0:1775764820.288159:0:7457:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 53 cancel update log [0x240000400:0x2:0x0].3: rc = 0 00000020:00080000:3.0:1775764820.288167:0:7457:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 53 00000004:00080000:3.0:1775764820.288177:0:7449:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96c2d12a8f00 version 9 rpc_version 9 00000020:00100000:3.0:1775764820.288198:0:7449:0:(genops.c:2442:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1775764820.288207:0:7449:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff96c1c35dd880 x1862023099816704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1775764820.288228:0:7449:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7449:1862023099816704:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1775764820.288274:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764820.288295:0:7449:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c2c0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1775764820.288308:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099816704 00000100:00100000:3.0:1775764820.288311:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099816704 00000100:00100000:3.0:1775764820.288351:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1775764820.288361:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1862023099816448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1775764820.288462:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1775764820.288470:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7449:x1862023099816704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1775764820.288530:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1862023099816448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (1319us total) trans 4294967727 rc 0/0 00000100:00100000:3.0:1775764820.288538:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1775764820.288588:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7449:x1862023099816704:12345-0@lo:1000:osp_up0-1.0 Request processed in 118us (311us total) trans 4294970675 rc 0/0 00000100:00100000:1.0:1775764820.288595:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1775764820.288611:0:7449:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7449:1862023099816704:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1775764820.288650:0:6525:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1862023099816448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1775764820.288702:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970674 00010000:00010000:1.0:1775764820.288727:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.288736:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.289384:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.289396:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764820.289401:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.289422:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.289452:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764820.289456:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1775764820.289461:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.289467:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523b0e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764820.289588:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000405:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1775764820.289661:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].65, 64 off13216 00000004:00080000:1.0:1775764820.289674:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1328110902253ns, next at 1329110899820ns, rc = 0 00000001:00080000:1.0:1775764820.289682:0:6525:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 4294970676 00010000:00010000:1.0:1775764820.289711:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764820.289713:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1775764820.289721:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523af9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5421 expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764820.290383:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:48249:x1862023076120192:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 27626us (27902us total) trans 4294970677 rc 0/0 00000100:00100000:1.0:1775764820.290393:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1372 00000020:00080000:1.0:1775764820.290399:0:6525:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1775764820.321073:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764820.321302:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076120704 00000100:00100000:3.0:1775764820.321314:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076120704 00000100:00100000:3.0:1775764820.321383:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6543 00000100:00100000:3.0:1775764820.321395:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:48250:x1862023076120704:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764820.321422:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764820.321456:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523b15 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5428 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321535:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321552:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321565:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321576:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321583:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321609:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321736:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321744:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321750:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764820.321763:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9d:0x0]: returning size 1516 00010000:00010000:3.0:1775764820.321873:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321881:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321888:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321894:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321900:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764820.321904:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321911:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321936:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:3.0:1775764820.321939:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764820.321946:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 3/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321951:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523b1c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321966:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321972:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321977:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.321982:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764820.321985:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.322003:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.322011:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:3.0:1775764820.322013:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764820.322016:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.322021:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523b23 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.322072:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523b15 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.322085:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.322093:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c1c2a04c00) 00010000:00010000:3.0:1775764820.322095:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764820.322097:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764820.322221:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:48250:x1862023076120704:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 828us (1158us total) trans 4294970678 rc 0/0 00000100:00100000:3.0:1775764820.322227:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6543 00000100:00100000:0.0:1775764820.326302:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764820.326369:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076120960 00000100:00100000:2.0:1775764820.326380:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076120960 00000100:00100000:2.0:1775764820.326449:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6544 00000100:00100000:2.0:1775764820.326461:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:48250:x1862023076120960:12345-192.168.202.58@tcp:55:lfs.0 00010000:00010000:2.0:1775764820.326527:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.326544:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.326554:0:14288:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.326590:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.326604:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 50 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764820.326620:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099816832:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764820.326719:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7900 going to sleep for 11 seconds 00000100:00100000:2.0:1775764820.332225:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099816832:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764820.332261:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764820.333019:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764820.333343:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076121088 00000100:00100000:3.0:1775764820.333353:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076121088 00010000:00010000:3.0:1775764820.333394:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 51 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764820.333446:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1418 00000100:00100000:3.0:1775764820.333455:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+51:2411:x1862023076121088:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764820.333471:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764820.333478:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 51 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333493:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 51 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333531:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523b2a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5428 expref: 51 pid: 24980 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333546:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c1c2a04c00) 00010000:00010000:3.0:1775764820.333551:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333561:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333570:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333596:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764820.333651:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:2411:x1862023076121088:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 196us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764820.333658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1418 00010000:00010000:3.0:1775764820.333681:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333689:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333913:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333921:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333927:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333939:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764820.333943:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333951:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333960:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c1c2a04c00) 00010000:00010000:3.0:1775764820.333963:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1775764820.333968:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764820.333974:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b38 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9d:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764820.334279:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:48250:x1862023076120960:12345-192.168.202.58@tcp:55:lfs.0 Request processed in 7821us (7986us total) trans 4294970679 rc 0/0 00000100:00100000:3.0:1775764820.334334:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6544 00000100:00100000:1.0:1775764820.345155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764820.348106:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076121344 00000100:00100000:2.0:1775764820.348130:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076121344 00000100:00100000:0.0:1775764820.349272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1373 00000100:00100000:1.0:1775764820.349348:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df702050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+50:48250:x1862023076121344:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:1.0:1775764820.349619:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df702050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+51:48250:x1862023076121344:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 335us (4473us total) trans 4294970680 rc 0/0 00000100:00100000:1.0:1775764820.349628:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1373 00000100:00100000:1.0:1775764820.387675:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764820.387858:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076121600 00000100:00100000:2.0:1775764820.387868:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076121600 00000100:00100000:2.0:1775764820.387932:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6545 00000100:00100000:2.0:1775764820.387943:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+51:48251:x1862023076121600:12345-192.168.202.58@tcp:101:md5sum.0 00010000:00010000:2.0:1775764820.387968:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764820.388062:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b3f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd542f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388163:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388178:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388192:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388204:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388211:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388218:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388353:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523b54 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388361:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523b54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.388383:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523b54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764820.388395:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9d:0x0]: returning size 1516 00010000:00010000:2.0:1775764820.389341:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389354:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389359:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389366:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389372:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764820.389377:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389384:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389398:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:2.0:1775764820.389402:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764820.389406:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389412:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b46 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389422:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389448:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389454:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389460:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764820.389463:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389469:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389476:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:2.0:1775764820.389479:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764820.389482:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389487:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b4d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389538:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b3f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd542f expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389551:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523b54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd542f expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764820.389558:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c1c4135900) 00010000:00010000:2.0:1775764820.389560:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764820.389568:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3800, rc 0) 00000100:00100000:2.0:1775764820.389652:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+53:48251:x1862023076121600:12345-192.168.202.58@tcp:101:md5sum.0 Request processed in 1710us (1984us total) trans 4294970681 rc 0/0 00000100:00100000:2.0:1775764820.389660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6545 00000100:00100000:3.0:1775764820.393563:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764820.393641:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076121856 00000100:00100000:1.0:1775764820.393654:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076121856 00000100:00100000:1.0:1775764820.393726:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 752 00000100:00100000:1.0:1775764820.393746:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+53:48251:x1862023076121856:12345-192.168.202.58@tcp:103:md5sum.0 00010000:00010000:1.0:1775764820.393762:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764820.393825:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523b54 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd542f expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764820.393843:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9d:0x0].0x0 (ffff96c1c4135900) 00010000:00010000:1.0:1775764820.393854:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764820.393908:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+52:48251:x1862023076121856:12345-192.168.202.58@tcp:103:md5sum.0 Request processed in 164us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764820.393916:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 752 00000100:00100000:1.0:1775764820.399385:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764820.399494:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076121984 00000100:00100000:0.0:1775764820.399507:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076121984 00000100:00100000:0.0:1775764820.399607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6546 00000100:00100000:0.0:1775764820.399618:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+52:48251:x1862023076121984:12345-192.168.202.58@tcp:58:md5sum.0 00000100:00100000:0.0:1775764820.399900:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+52:48251:x1862023076121984:12345-192.168.202.58@tcp:58:md5sum.0 Request processed in 284us (531us total) trans 0 rc -1/-1 00000100:00100000:0.0:1775764820.399908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6546 00000100:00100000:1.0:1775764820.404131:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764820.404359:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076122240 00000100:00100000:2.0:1775764820.404369:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076122240 00000100:00100000:2.0:1775764820.404440:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1374 00000100:00100000:2.0:1775764820.404452:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+52:48251:x1862023076122240:12345-192.168.202.58@tcp:35:md5sum.0 00000100:00100000:2.0:1775764820.404723:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+53:48251:x1862023076122240:12345-192.168.202.58@tcp:35:md5sum.0 Request processed in 272us (602us total) trans 4294970682 rc 0/0 00000100:00100000:2.0:1775764820.404741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1374 00010000:00010000:1.0:1775764820.852282:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1775764821.184033:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970682 is committed 00000004:00080000:1.0:1775764821.184059:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000001:00080000:1.0:1775764821.184094:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970675 is committed 00000020:00080000:1.0:1775764821.184103:0:6499:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96c2f732c180 refcount 2 committed 0 result 0 batchid 124 00000020:00080000:1.0:1775764821.184107:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2d85100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96c2c416aa80 00000020:00080000:1.0:1775764821.184110:0:6499:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff96c1c2d85300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96c2f9a9de00 00000001:00080000:1.0:1775764821.184164:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970667 is committed 00010000:00010000:3.0:1775764821.184251:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184264:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184272:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184278:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43ce000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764821.184282:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184297:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184318:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x832cc65c (ffff96c1c4135e00) 00010000:00010000:3.0:1775764821.184322:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764821.184328:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184333:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed523978 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x832cc65c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184353:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184360:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184365:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184369:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cfc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764821.184372:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184377:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184384:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff96c1c4135600) 00010000:00010000:3.0:1775764821.184386:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764821.184388:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764821.184400:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52397f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1775764821.184808:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 124 committed batchid 123 00000020:00080000:2.0:1775764821.184879:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 123 00010000:00010000:0.0:1775764821.186994:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187008:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187015:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187021:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764821.187026:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187035:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187054:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0xa926940c (ffff96c2c7ea7700) 00010000:00010000:0.0:1775764821.187058:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764821.187063:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187069:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523a51 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0xa926940c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764821.187160:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099816960:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1775764821.187251:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764821.187418:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099816960 00000100:00100000:0.0:1775764821.187435:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099816960 00000100:00100000:0.0:1775764821.187512:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:0.0:1775764821.187540:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2dfdd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099816960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1775764821.187570:0:24969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:86 count 1 00002000:00010000:0.0:1775764821.187601:0:24969:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x56:0x0] initial LVB size: 1516, mtime: 0x69d80550, atime: 0x0, ctime: 0x69d80550, blocks: 0x8 00010000:00010000:0.0:1775764821.187608:0:24969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187623:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764821.187625:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764821.187631:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187646:0:24969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187655:0:24969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187663:0:24969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.187698:0:24969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1775764821.187885:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2dfdd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3661:x1862023099816960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 346us (633us total) trans 4294967728 rc 0/0 00000100:00100000:0.0:1775764821.187892:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00010000:00010000:0.0:1775764821.188074:0:6509:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775764821.188080:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.188101:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764821.188105:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.188112:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.188128:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.188136:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055f746d6/0x6e98bd47ed523b62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764821.188153:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764821.188155:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764821.188157:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1775764821.188320:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1775764821.188360:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c2f98c6300/2, rc 0, transno 4294967728 00000100:00100000:3.0:1775764821.188368:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099816960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1775764821.822387:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764821.822425:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099817088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1775764821.822497:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764821.822565:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817088 00000100:00100000:1.0:1775764821.822574:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817088 00000100:00100000:1.0:1775764821.822619:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1775764821.822627:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099817088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764821.822664:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444225024 avail 1297985536 00000100:00100000:1.0:1775764821.822709:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099817088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764821.822729:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1775764821.824063:0:3661:0:(client.c:3082:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294970675 gen 2 00000004:00080000:1.0:1775764821.824074:0:3661:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294970675 committed transno 4294970675 00000100:00100000:1.0:1775764821.824110:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099817088:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1775764821.873933:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764822.834310:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099817216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764822.834398:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764822.834739:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764822.834748:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099817344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764822.834810:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764822.834947:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817216 00000100:00100000:2.0:1775764822.834955:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817216 00000100:00100000:2.0:1775764822.835022:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817344 00000100:00100000:2.0:1775764822.835026:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817344 00000100:00100000:2.0:1775764822.835050:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1775764822.835058:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099817216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1775764822.835087:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:2.0:1775764822.835142:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099817216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764822.835149:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1775764822.835167:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1775764822.835173:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099817344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1775764822.835183:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 58151104 pending 0 free 3916955648 avail 3685433344 00000100:00100000:2.0:1775764822.835204:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099817344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764822.835225:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1775764822.835377:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099817344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764822.835392:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099817216:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1775764822.835464:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1775764822.898021:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764823.860811:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099817472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764823.860887:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764823.861247:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817472 00000100:00100000:2.0:1775764823.861256:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817472 00000100:00100000:2.0:1775764823.861304:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1775764823.861314:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099817472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1775764823.861352:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:2.0:1775764823.861414:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099817472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764823.861421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1775764823.861515:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099817472:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1775764823.925182:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764824.209534:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764824.209584:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764824.209650:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764824.209879:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076122368 00000100:00100000:3.0:1775764824.209890:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076122368 00000100:00100000:3.0:1775764824.209953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 969 00000100:00100000:3.0:1775764824.209971:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076122368:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764824.210015:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076122624 00000100:00100000:2.0:1775764824.210021:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076122624 00000100:00100000:3.0:1775764824.210057:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076122368:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 87us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764824.210065:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076122496 00000100:00100000:3.0:1775764824.210068:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 969 00000100:00100000:2.0:1775764824.210070:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076122496 00000100:00100000:2.0:1775764824.210099:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1925 00000100:00080000:3.0:1775764824.210106:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764824.210111:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764824.210118:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076122624:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764824.210125:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1926 00000100:00100000:3.0:1775764824.210136:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:2411:x1862023076122496:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764824.210153:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076122624:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 47us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764824.210161:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1925 00000100:00100000:3.0:1775764824.210173:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:2411:x1862023076122496:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.210189:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1926 00000100:00100000:3.0:1775764824.218973:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764824.219082:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764824.219113:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764824.219143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764824.219204:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123008 00000100:00100000:0.0:1775764824.219216:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123008 00000100:00100000:0.0:1775764824.219283:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123136 00000100:00100000:0.0:1775764824.219286:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123136 00000100:00100000:1.0:1775764824.219310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1927 00000100:00100000:1.0:1775764824.219327:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:2410:x1862023076123008:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764824.219415:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:2410:x1862023076123008:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764824.220997:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1928 00000100:00100000:0.0:1775764824.221019:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076123136:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764824.221093:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076123136:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 84us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764824.221102:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1928 00000100:00080000:0.0:1775764824.221243:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764824.221248:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764824.223536:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1927 00000100:00100000:3.0:1775764824.223842:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764824.229410:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076122880 00000100:00100000:2.0:1775764824.229430:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076122880 00000100:00100000:2.0:1775764824.229564:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123264 00000100:00100000:2.0:1775764824.229568:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123264 00000100:00100000:2.0:1775764824.229597:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1403 00000100:00100000:2.0:1775764824.229608:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076122880:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764824.229715:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076122880:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 109us (10760us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764824.229738:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1403 00000100:00100000:2.0:1775764824.229760:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1404 00000100:00100000:2.0:1775764824.229796:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076123264:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764824.229825:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2410:x1862023076123264:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 60us (10682us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764824.229831:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1404 00000100:00080000:1.0:1775764824.230651:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1775764824.230659:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764824.231239:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123392 00000100:00100000:1.0:1775764824.231250:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123392 00000100:00100000:1.0:1775764824.231319:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1405 00000100:00100000:1.0:1775764824.231329:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076123392:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764824.231422:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076123392:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 94us (7580us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764824.231430:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1405 00000100:00100000:3.0:1775764824.231911:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764824.232283:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076122752 00000100:00100000:1.0:1775764824.232290:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076122752 00000100:00100000:1.0:1775764824.232330:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1729 00000100:00100000:1.0:1775764824.232339:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+5:2407:x1862023076122752:12345-192.168.202.58@tcp:9:kworker.0 00000020:00000080:1.0:1775764824.232365:0:8403:0:(genops.c:1487:class_disconnect()) disconnect: cookie 0x6e98bd47ed522f0d 00000100:00080000:1.0:1775764824.232375:0:8403:0:(import.c:65:import_set_state_nolock()) ffff96c1c4ded800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1775764824.232434:0:8403:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967728 00000100:00100000:1.0:1775764824.232577:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+2:2407:x1862023076122752:12345-192.168.202.58@tcp:9:kworker.0 Request processed in 238us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764824.232585:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1729 00010000:00010000:1.0:1775764824.232605:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1775764824.232943:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1775764824.232948:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1775764824.371469:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967728 is committed 00000001:00080000:3.0:1775764824.371494:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967726 is committed 00000100:00100000:1.0:1775764824.374004:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099817856:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.374080:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764824.374138:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099818368:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.374164:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764824.374186:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099818880:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.374206:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764824.374228:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1775764824.374233:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099817728:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.374253:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764824.374269:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099818240:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.374289:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764824.374302:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099818752:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.374319:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764824.374350:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817856 00000100:00100000:1.0:1775764824.374358:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817856 00000100:00100000:1.0:1775764824.374428:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1775764824.374438:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099817856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374452:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099817600:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374491:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374517:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099818112:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374538:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374556:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099818624:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374575:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374590:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099819136:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374608:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374627:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1775764824.374633:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099817984:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374653:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374668:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099818496:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374686:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374702:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099819008:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374719:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.374757:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818112 00000100:00100000:3.0:1775764824.374761:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818112 00000100:00100000:3.0:1775764824.374812:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1775764824.374819:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099818112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.374844:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817600 00000100:00100000:0.0:1775764824.374850:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817600 00000100:00100000:3.0:1775764824.374858:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099818112:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.374865:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1775764824.374890:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818368 00000100:00100000:0.0:1775764824.374893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1775764824.374895:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818368 00000100:00100000:0.0:1775764824.374903:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099817600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.374932:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818880 00000100:00100000:3.0:1775764824.374936:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818880 00000100:00100000:0.0:1775764824.374947:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099817600:12345-0@lo:400:kworker.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.374950:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817728 00000100:00100000:3.0:1775764824.374955:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817728 00000100:00100000:0.0:1775764824.374958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1775764824.374969:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818240 00000100:00100000:3.0:1775764824.374971:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818240 00000100:00100000:3.0:1775764824.374988:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818752 00000100:00100000:3.0:1775764824.374990:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818752 00000100:00100000:0.0:1775764824.374998:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099817984 00000100:00100000:0.0:1775764824.375004:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099817984 00000100:00100000:3.0:1775764824.375007:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1775764824.375015:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099818368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:0.0:1775764824.375042:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099818880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375048:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099818368:12345-0@lo:400:kworker.0 Request processed in 34us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.375054:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1775764824.375067:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1775764824.375073:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099817728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375099:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099818880:12345-0@lo:400:kworker.0 Request processed in 59us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764824.375109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1775764824.375110:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099817728:12345-0@lo:400:kworker.0 Request processed in 35us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.375119:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:0.0:1775764824.375132:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1775764824.375138:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:0.0:1775764824.375142:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099818240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375148:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099818752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375184:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099818240:12345-0@lo:400:kworker.0 Request processed in 43us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764824.375192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1775764824.375193:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099818752:12345-0@lo:400:kworker.0 Request processed in 46us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.375201:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:0.0:1775764824.375212:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:0.0:1775764824.375220:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099817984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375242:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099817600:0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375259:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099817984:12345-0@lo:400:kworker.0 Request processed in 39us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.375259:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099818112:0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1775764824.375286:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099817984:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375338:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818624 00000100:00100000:3.0:1775764824.375341:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818624 00000100:00100000:0.0:1775764824.375356:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099817728:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375366:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819136 00000100:00100000:3.0:1775764824.375370:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819136 00000100:00100000:0.0:1775764824.375372:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099818240:0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375387:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099818752:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375388:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099818496 00000100:00100000:3.0:1775764824.375404:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099818496 00000100:00100000:0.0:1775764824.375415:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099818368:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375420:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819008 00000100:00100000:3.0:1775764824.375423:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819008 00000100:00100000:0.0:1775764824.375432:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099818880:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375439:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1775764824.375445:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099818624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375473:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1775764824.375482:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099818624:12345-0@lo:400:kworker.0 Request processed in 37us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764824.375484:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099819136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375492:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1775764824.375505:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1775764824.375512:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099818496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375529:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099819136:12345-0@lo:400:kworker.0 Request processed in 47us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764824.375536:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1775764824.375542:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099818496:12345-0@lo:400:kworker.0 Request processed in 31us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.375550:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1775764824.375556:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1775764824.375566:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099819008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375579:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099818496:0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375603:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099819008:12345-0@lo:400:kworker.0 Request processed in 39us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.375604:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099819008:0@lo:400:kworker.0 00000100:00100000:0.0:1775764824.375616:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1775764824.375620:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099818624:0@lo:400:kworker.0 00000100:00100000:3.0:1775764824.375631:0:3662:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967728 gen 2 00000004:00080000:3.0:1775764824.375636:0:3662:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967727 committed transno 4294967728 00000004:00080000:3.0:1775764824.375651:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c2f98c6300, transno 4294967728 00000100:00100000:3.0:1775764824.375664:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099819136:0@lo:400:kworker.0 00000100:00100000:1.0:1775764824.375974:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099817856:12345-0@lo:400:kworker.0 Request processed in 1536us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764824.375981:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1775764824.376058:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099817856:0@lo:400:kworker.0 00000100:00080000:2.0:1775764824.376436:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1775764824.376442:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1775764824.376445:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764824.376447:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764824.883807:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099819264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764824.883906:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764824.883999:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764824.884007:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099819392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764824.884031:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764824.884384:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819264 00000100:00100000:3.0:1775764824.884403:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819264 00000100:00100000:3.0:1775764824.884451:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819392 00000100:00100000:3.0:1775764824.884454:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819392 00000100:00100000:3.0:1775764824.884469:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1775764824.884478:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099819264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1775764824.884509:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:3.0:1775764824.884558:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099819264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.884566:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1775764824.884583:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:3.0:1775764824.884589:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099819392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1775764824.884598:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:3.0:1775764824.884636:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099819392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764824.884642:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1775764824.886361:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099819392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764824.886409:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099819264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1775764824.946193:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764825.394212:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764825.394223:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764825.394247:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 151 count 2 00000040:00080000:2.0:1775764825.394253:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764825.912891:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764825.912990:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123520 00000100:00100000:3.0:1775764825.913003:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123520 00000100:00100000:3.0:1775764825.913089:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6547 00000100:00100000:3.0:1775764825.913099:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:48223:x1862023076123520:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1775764825.913234:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+48:48223:x1862023076123520:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 135us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764825.913242:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6547 00000100:00100000:2.0:1775764825.926297:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764825.926376:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123648 00000100:00100000:0.0:1775764825.926402:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123648 00000100:00100000:0.0:1775764825.926525:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6548 00000100:00100000:0.0:1775764825.926538:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:48223:x1862023076123648:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764825.926665:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:48223:x1862023076123648:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 129us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764825.926673:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6548 00010000:00010000:2.0:1775764825.970058:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1775764826.933382:0:6499:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 124 batchid updated 00000020:00080000:1.0:1775764826.933767:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 124 00000020:00080000:1.0:1775764826.933808:0:6553:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 124 00000100:00100000:3.0:1775764826.942818:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775764826.942841:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099819520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764826.942907:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764826.942969:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819520 00000100:00100000:3.0:1775764826.942975:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819520 00000100:00100000:3.0:1775764826.943021:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1775764826.943030:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099819520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764826.943067:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444225024 avail 1297985536 00000100:00100000:3.0:1775764826.943125:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099819520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764826.943133:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1775764826.943179:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099819520:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1775764826.995917:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775764827.772903:0:30912:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 16:00:25 (1775764825) 00000100:00100000:1.0:1775764827.954948:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099819648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764827.955022:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764827.955115:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819648 00000100:00100000:1.0:1775764827.955126:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819648 00000100:00100000:1.0:1775764827.955188:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:1.0:1775764827.955199:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099819648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764827.955234:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25530560 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764827.955278:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099819648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764827.955285:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:1.0:1775764827.955333:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099819648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764827.958622:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099819776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764827.958692:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764827.958745:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099819776 00000100:00100000:1.0:1775764827.958753:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099819776 00000100:00100000:1.0:1775764827.958833:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1775764827.958843:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099819776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764827.958864:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25530560 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764827.958916:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099819776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764827.958923:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1775764827.959189:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099819776:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1775764827.959905:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1775764828.019293:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764828.019303:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:1.0:1775764828.019331:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764828.019925:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1775764828.019935:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764828.097035:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764828.097651:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076123904 00000100:00100000:2.0:1775764828.097665:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076123904 00000100:00100000:2.0:1775764828.097743:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6549 00000100:00100000:2.0:1775764828.097754:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+48:48862:x1862023076123904:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764828.097797:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764828.097818:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523b69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5436 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.097924:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.097940:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.097953:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.097967:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.097974:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.097980:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.098078:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.098087:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.098093:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764828.098102:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000100:00080000:3.0:1775764828.098379:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1775764828.098625:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098634:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098640:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098652:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098659:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764828.098663:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098671:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098687:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:3.0:1775764828.098690:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764828.098696:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098703:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523b70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098716:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098723:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098728:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098733:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764828.098735:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098751:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098759:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c1c4135400) 00010000:00010000:3.0:1775764828.098762:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764828.098765:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.098794:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523b77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.099094:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523b69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5436 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.099110:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5436 expref: 50 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.099118:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764828.099121:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764828.099124:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3600, rc 0) 00000100:00100000:3.0:1775764828.099207:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:48862:x1862023076123904:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1455us (2188us total) trans 4294970683 rc 0/0 00000100:00100000:3.0:1775764828.099215:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6549 00000100:00100000:2.0:1775764828.106616:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764828.106660:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.107186:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076124160 00000100:00100000:3.0:1775764828.107197:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076124160 00000100:00100000:3.0:1775764828.107246:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1375 00000100:00100000:3.0:1775764828.107256:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48862:x1862023076124160:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764828.107512:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+51:48862:x1862023076124160:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 257us (905us total) trans 4294970684 rc 0/0 00000100:00100000:3.0:1775764828.107520:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1375 00000100:00100000:0.0:1775764828.107593:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076124288 00000100:00100000:0.0:1775764828.107599:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076124288 00000100:00100000:0.0:1775764828.107633:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 753 00000100:00100000:0.0:1775764828.107640:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:2409:x1862023076124288:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764828.107650:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764828.107687:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523b7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5436 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.107705:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764828.107710:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764828.107746:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+50:2409:x1862023076124288:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 107us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.107762:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 753 00000100:00100000:2.0:1775764828.119746:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.119823:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076124416 00000100:00100000:0.0:1775764828.119835:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076124416 00000100:00080000:3.0:1775764828.119917:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764828.119937:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6550 00000100:00100000:1.0:1775764828.119950:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:48863:x1862023076124416:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764828.119973:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764828.119993:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd543d expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120081:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120098:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120111:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120126:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120132:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120138:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120443:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120450:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120456:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120462:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764828.120466:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120483:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120502:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764828.120505:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.120510:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120515:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120529:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120534:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120540:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120544:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764828.120546:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120551:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120557:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46b7907 (ffff96c2c7e0fd00) 00010000:00010000:1.0:1775764828.120560:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.120562:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120575:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523b9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120606:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523b8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd543d expref: 38 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120615:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764828.120617:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.120620:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd543d expref: 38 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.120628:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5000, rc 0) 00000100:00100000:1.0:1775764828.120696:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:48863:x1862023076124416:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 749us (961us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764828.120704:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6550 00000100:00100000:3.0:1775764828.123003:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.123075:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076124544 00000100:00100000:0.0:1775764828.123085:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076124544 00000100:00100000:0.0:1775764828.123148:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6551 00000100:00100000:0.0:1775764828.123158:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:48862:x1862023076124544:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1775764828.123272:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:48862:x1862023076124544:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 115us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.123279:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6551 00000100:00100000:3.0:1775764828.126763:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.129875:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076124672 00000100:00100000:0.0:1775764828.129894:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076124672 00000100:00100000:0.0:1775764828.129982:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6552 00000100:00100000:0.0:1775764828.129995:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:48862:x1862023076124672:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1775764828.130370:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764828.130985:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:48862:x1862023076124672:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 135us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.130996:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6552 00000100:00100000:1.0:1775764828.133705:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.133821:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076124928 00000100:00100000:3.0:1775764828.133834:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076124928 00000100:00100000:3.0:1775764828.133904:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6553 00000100:00100000:3.0:1775764828.133916:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+37:48863:x1862023076124928:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:3.0:1775764828.133985:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764828.134019:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed52398d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5395 expref: 37 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.134039:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764828.134044:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764828.134109:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.134138:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.134147:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.134188:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 49 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.134218:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 49 pid: 10681 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764828.134234:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c73fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099819904:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764828.134337:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d13c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1775764828.138415:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c73fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099819904:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764828.138456:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764828.146959:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.149327:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076125056 00000100:00100000:3.0:1775764828.149341:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076125056 00010000:00010000:3.0:1775764828.149398:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 50 pid: 10681 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764828.149444:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1419 00000100:00100000:3.0:1775764828.149455:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:2411:x1862023076125056:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764828.149472:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764828.149480:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 50 pid: 10681 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.149494:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 50 pid: 10681 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.149518:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5239cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd53aa expref: 50 pid: 10681 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.149537:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764828.149541:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.149570:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.149578:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.149603:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764828.149966:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:2411:x1862023076125056:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 229us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.149976:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1419 00010000:00010000:0.0:1775764828.150114:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.150122:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.150263:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x46b7907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.150274:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.150281:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151677:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,1 mode: --/PW res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151704:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151716:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764828.151736:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000daf9a137 reply state 00000000cffd3e10 transno 4294970685 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151747:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151754:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.151757:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1775764828.151761:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1775764828.151796:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x16:0x0]: returning size 4096 00010000:00010000:0.0:1775764828.151806:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151813:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151831:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151838:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151844:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.151849:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151857:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151868:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764828.151871:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.151874:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151881:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed523ba1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764828.151897:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000daf9a137 reply state 00000000cffd3e10 transno 4294970685 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151905:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.151911:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46b7907 (ffff96c2c6356600) 00010000:00010000:0.0:1775764828.151914:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1775764828.151916:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1775764828.152022:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:48863:x1862023076124928:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 18105us (18338us total) trans 4294970685 rc 0/0 00000100:00100000:0.0:1775764828.152036:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6553 00000100:00100000:1.0:1775764828.220156:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764828.220261:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076125184 00000100:00100000:2.0:1775764828.220271:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076125184 00000100:00100000:2.0:1775764828.220335:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6554 00000100:00100000:2.0:1775764828.220345:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+49:48867:x1862023076125184:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:2.0:1775764828.220377:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764828.220399:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523bb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5444 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.220470:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.220485:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.220498:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764828.220547:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1775764828.220551:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764828.220573:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.220598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523bb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.220617:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.220625:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764828.220628:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764828.220646:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3600, rc 0) 00000100:00100000:2.0:1775764828.220725:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48867:x1862023076125184:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 381us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764828.220733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6554 00000100:00100000:3.0:1775764828.225583:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.225629:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764828.225709:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076125312 00000100:00100000:2.0:1775764828.225719:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076125312 00000100:00100000:2.0:1775764828.225803:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076125568 00000100:00100000:2.0:1775764828.225806:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076125568 00000100:00100000:2.0:1775764828.225837:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6555 00000100:00100000:2.0:1775764828.225848:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+16:2409:x1862023076125312:12345-192.168.202.58@tcp:41:mkdir.0 00000100:00100000:1.0:1775764828.225885:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6556 00000004:00000024:2.0:1775764828.225890:0:10088:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1775764828.225898:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+16:48867:x1862023076125568:12345-192.168.202.58@tcp:36:mkdir.0 00000100:00100000:2.0:1775764828.225965:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+16:2409:x1862023076125312:12345-192.168.202.58@tcp:41:mkdir.0 Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764828.225983:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6555 00000100:00100000:1.0:1775764828.226020:0:6523:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6523:1862023099820032:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1775764828.226072:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764828.226114:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099820032 00000100:00100000:2.0:1775764828.226118:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099820032 00000100:00100000:1.0:1775764828.226129:0:6523:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c6354780 going to sleep for 11 seconds 00000100:00100000:2.0:1775764828.226150:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1775764828.226157:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6523:x1862023099820032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1775764828.226221:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6523:x1862023099820032:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764828.226228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1775764828.226275:0:6523:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6523:1862023099820032:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1775764828.226326:0:6523:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6523:1862023099820160:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1775764828.226382:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764828.226404:0:6523:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c6354000 going to sleep for 11 seconds 00000100:00100000:2.0:1775764828.227319:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099820160 00000100:00100000:2.0:1775764828.227327:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099820160 00000100:00100000:2.0:1775764828.227439:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1775764828.227459:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6523:x1862023099820160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1775764828.227604:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6523:x1862023099820160:12345-0@lo:1000:mdt00_002.0 Request processed in 146us (1221us total) trans 0 rc 1/1 00000100:00100000:2.0:1775764828.227623:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1775764828.228191:0:6523:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6523:1862023099820160:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1775764828.228281:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:48867:x1862023076125568:12345-192.168.202.58@tcp:36:mkdir.0 Request processed in 2385us (2649us total) trans 0 rc -17/-17 00000100:00100000:1.0:1775764828.228290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6556 00000100:00100000:3.0:1775764828.231653:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.231808:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076125696 00000100:00100000:0.0:1775764828.231818:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076125696 00000100:00100000:0.0:1775764828.231880:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6557 00000100:00100000:0.0:1775764828.231889:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+50:48867:x1862023076125696:12345-192.168.202.58@tcp:101:mkdir.0 00010000:00010000:0.0:1775764828.231910:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764828.231931:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd544b expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232001:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232012:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232021:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232033:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232039:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232046:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232123:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523bd9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232148:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232155:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764828.232189:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x16:0x0]: returning size 4096 00000004:00200000:0.0:1775764828.232193:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764828.232210:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232222:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232229:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232235:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232241:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232247:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.232251:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232258:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232270:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764828.232278:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.232284:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232291:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232307:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232312:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232315:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232318:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.232320:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232323:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232327:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46b7907 (ffff96c2c6356600) 00010000:00010000:0.0:1775764828.232329:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.232330:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232333:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523bd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232369:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd544b expref: 52 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232397:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd544b expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.232404:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.232406:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764828.232408:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d000, rc 0) 00000100:00100000:0.0:1775764828.232993:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+51:48867:x1862023076125696:12345-192.168.202.58@tcp:101:mkdir.0 Request processed in 1102us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.233002:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6557 00000100:00100000:3.0:1775764828.244318:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.244582:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076125824 00000100:00100000:0.0:1775764828.244592:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076125824 00000100:00100000:0.0:1775764828.244688:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6558 00000100:00100000:0.0:1775764828.244697:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:48868:x1862023076125824:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:0.0:1775764828.244717:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764828.244735:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523be0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5452 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244848:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244865:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244877:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244892:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 3/1,0 mode: --/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244914:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244921:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244959:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244977:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244983:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244988:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.244992:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.244995:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245000:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245008:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.245010:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.245014:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245020:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523be7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245043:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245049:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245054:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245059:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.245061:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245068:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245086:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x55b14e68 (ffff96c2c6356800) 00010000:00010000:0.0:1775764828.245089:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.245092:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 2/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245097:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bee lrc: 0/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245130:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523be0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5452 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245141:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.245144:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.245153:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523be0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5452 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.245163:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c400, rc 0) 00000100:00100000:0.0:1775764828.245224:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:48868:x1862023076125824:12345-192.168.202.58@tcp:101:rm.0 Request processed in 529us (919us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764828.245230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6558 00000100:00100000:3.0:1775764828.254399:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.255314:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126080 00000100:00100000:0.0:1775764828.255327:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126080 00000100:00100000:0.0:1775764828.255443:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6559 00000100:00100000:0.0:1775764828.255454:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+51:48869:x1862023076126080:12345-192.168.202.58@tcp:101:dd.0 00010000:00010000:0.0:1775764828.255477:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764828.255480:0:10681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1775764828.255511:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523bd9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd544b expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.255534:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.255621:0:10681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764828.255634:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523bf5 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5459 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.255734:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.255745:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.255752:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.256993:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.257004:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.257029:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1775764828.257456:0:10681:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x56:0x0], index 0: 0 00010000:00010000:0.0:1775764828.258272:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523c0a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258284:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523c0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258291:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523c0a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258319:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258324:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258329:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258332:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.258335:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258354:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258378:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.258381:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.258386:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 2/0,0 mode: --/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258392:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523bfc lrc: 0/0,0 mode: --/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764828.258407:0:10681:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000386d9209 reply state 00000000011097ec transno 4294970686 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258419:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258425:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x55b14e68 (ffff96c2c6356800) 00010000:00010000:0.0:1775764828.258427:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1775764828.258431:0:10681:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1775764828.258471:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523bf5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5459 expref: 53 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258487:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6ce00/0x6e98bd47ed523c0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5459 expref: 52 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.258494:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:0.0:1775764828.258496:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764828.258498:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6ce00, rc 0) 00000100:00100000:0.0:1775764828.258585:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+53:48869:x1862023076126080:12345-192.168.202.58@tcp:101:dd.0 Request processed in 3132us (4194us total) trans 4294970686 rc 0/0 00000100:00100000:0.0:1775764828.258595:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6559 00000100:00100000:3.0:1775764828.264010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.264253:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126336 00000100:00100000:1.0:1775764828.264264:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126336 00000100:00100000:1.0:1775764828.264325:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1376 00000100:00100000:1.0:1775764828.264335:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+53:48869:x1862023076126336:12345-192.168.202.58@tcp:35:dd.0 00000100:00100000:1.0:1775764828.264757:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+54:48869:x1862023076126336:12345-192.168.202.58@tcp:35:dd.0 Request processed in 423us (756us total) trans 4294970687 rc 0/0 00000100:00100000:1.0:1775764828.264766:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1376 00000100:00100000:3.0:1775764828.310542:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.311026:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126464 00000100:00100000:1.0:1775764828.311442:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126464 00000100:00100000:1.0:1775764828.311616:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6560 00000100:00100000:1.0:1775764828.311627:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+54:48870:x1862023076126464:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764828.311654:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764828.311678:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5460 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.311749:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.311904:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.311936:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.311948:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.311956:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.311963:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.312351:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523c2d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.312370:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523c2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.312376:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523c2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764828.312419:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1775764828.312424:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764828.313868:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523c2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313893:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313900:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313925:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313931:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313936:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764828.313941:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313947:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313962:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764828.313964:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.313969:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313974:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313991:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.313997:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.314001:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.314005:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764828.314012:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.314019:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.314027:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46b7907 (ffff96c2c6356600) 00010000:00010000:1.0:1775764828.314029:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.314032:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.315280:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.315342:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5460 expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.315365:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4600/0x6e98bd47ed523c2d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5460 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.315375:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:1.0:1775764828.315377:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1775764828.315380:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4600, rc 0) 00000100:00100000:1.0:1775764828.315477:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:48870:x1862023076126464:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 3850us (4943us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.315486:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6560 00000100:00100000:3.0:1775764828.350334:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764828.350648:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126592 00000100:00100000:2.0:1775764828.350739:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126592 00000100:00100000:3.0:1775764828.350996:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6561 00000100:00100000:3.0:1775764828.351007:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+38:48872:x1862023076126592:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764828.351113:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764828.351136:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523c34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5467 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.351211:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523c3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.351227:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.351252:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764828.351306:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1775764828.351311:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764828.351332:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.351475:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8600/0x6e98bd47ed523c34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5467 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.351497:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523c3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5467 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.351508:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764828.351511:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764828.351515:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9600, rc 0) 00000100:00100000:3.0:1775764828.351736:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:48872:x1862023076126592:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 650us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.351745:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6561 00000100:00100000:3.0:1775764828.355642:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.358955:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126720 00000100:00100000:0.0:1775764828.358973:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126720 00000100:00100000:0.0:1775764828.359092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6562 00000100:00100000:0.0:1775764828.359102:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+39:48872:x1862023076126720:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764828.359123:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764828.359145:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523c42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd546e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359212:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359227:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359240:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359251:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359257:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359264:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359344:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523c57 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359384:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523c57 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359391:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523c57 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764828.359426:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x16:0x0]: returning size 4096 00000004:00200000:0.0:1775764828.359430:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764828.359451:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523c57 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359463:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359469:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359475:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359480:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359486:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.359491:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359500:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359512:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764828.359520:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.359527:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359533:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523c49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359549:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359555:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359560:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359565:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764828.359568:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359573:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359581:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46b7907 (ffff96c2c6356600) 00010000:00010000:0.0:1775764828.359583:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764828.359586:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359591:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523c50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359617:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523c42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd546e expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359642:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0600/0x6e98bd47ed523c57 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd546e expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.359650:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:0.0:1775764828.359652:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1775764828.359667:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0600, rc 0) 00000100:00100000:0.0:1775764828.359749:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:48872:x1862023076126720:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 648us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.359756:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6562 00000100:00100000:2.0:1775764828.369151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.370555:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126848 00000100:00100000:0.0:1775764828.370632:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126848 00000100:00100000:1.0:1775764828.370849:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6563 00000100:00100000:1.0:1775764828.370860:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:48872:x1862023076126848:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764828.370885:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764828.370921:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c5e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5475 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.370989:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371004:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371015:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371171:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371181:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371187:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371263:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523c73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371272:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523c73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371280:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523c73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764828.371319:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9e:0x0]: returning size 0 00000004:00200000:1.0:1775764828.371324:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764828.371344:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523c73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371380:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523c73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371389:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371395:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371401:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371407:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764828.371411:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371418:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371430:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:1.0:1775764828.371433:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.371439:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371444:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c65 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371457:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371463:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371475:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371480:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764828.371483:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371489:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371496:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x55b14e68 (ffff96c2c6356800) 00010000:00010000:1.0:1775764828.371499:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764828.371501:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371507:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c6c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371534:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c5e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5475 expref: 42 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371546:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4800/0x6e98bd47ed523c73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5475 expref: 41 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.371553:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:1.0:1775764828.371555:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764828.371557:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4800, rc 0) 00000100:00100000:1.0:1775764828.371638:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:48872:x1862023076126848:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 778us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.371664:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6563 00000100:00100000:2.0:1775764828.380068:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.380207:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076126976 00000100:00100000:3.0:1775764828.380218:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076126976 00000100:00100000:3.0:1775764828.380303:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1730 00000100:00100000:3.0:1775764828.380313:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+7:2409:x1862023076126976:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764828.380331:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764828.380368:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523c7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd547c expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764828.380415:0:8641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1775764828.380436:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764828.380438:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764828.380448:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523c7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd547c expref: 8 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.380467:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045c6c734/0x6e98bd47ed523c7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd547c expref: 8 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.380482:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8600, rc 0) 00000100:00100000:3.0:1775764828.380549:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2409:x1862023076126976:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 237us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.380557:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1730 00000100:00080000:0.0:1775764828.380574:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764828.384911:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.385269:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076127104 00000100:00100000:1.0:1775764828.385284:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076127104 00000100:00100000:1.0:1775764828.385369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6564 00000100:00100000:1.0:1775764828.385380:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:48872:x1862023076127104:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764828.385403:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764828.385426:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5483 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.385502:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c88 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.385518:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c88 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.385530:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c88 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764828.385577:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1775764828.385581:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764828.385603:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c88 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.385628:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5483 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.385647:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5600/0x6e98bd47ed523c88 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5483 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.385686:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:1.0:1775764828.385689:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764828.385693:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5600, rc 0) 00000100:00100000:1.0:1775764828.385765:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48872:x1862023076127104:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 387us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.385837:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6564 00000100:00100000:2.0:1775764828.403089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.403282:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076127360 00000100:00100000:3.0:1775764828.403293:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076127360 00000100:00100000:3.0:1775764828.403370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6565 00000100:00100000:3.0:1775764828.403381:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48872:x1862023076127360:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:3.0:1775764828.403567:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].151, 136 off28520 00000100:00100000:3.0:1775764828.403672:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48872:x1862023076127360:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 294us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.403679:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6565 00000040:00080000:3.0:1775764828.466092:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764828.466101:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764828.466127:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 152 count 3 00000040:00080000:3.0:1775764828.466150:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764828.466598:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61ba300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099820288:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1775764828.466726:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d13c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1775764828.480337:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.481314:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076127488 00000100:00100000:0.0:1775764828.481325:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076127488 00000100:00100000:0.0:1775764828.481422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6566 00000100:00100000:0.0:1775764828.481432:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076127488:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1775764828.481470:0:6521:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9e:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1775764828.481601:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076127488:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 170us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.481609:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6566 00000100:00100000:3.0:1775764828.482890:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61ba300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099820288:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764828.492285:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.492406:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076127744 00000100:00100000:1.0:1775764828.492417:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076127744 00000100:00100000:1.0:1775764828.492480:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6567 00000100:00100000:1.0:1775764828.492490:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:48878:x1862023076127744:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764828.492515:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764828.492539:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd548a expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.492677:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.492694:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.492706:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764828.492718:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9e:0x0]: returning size 0 00010000:00010000:1.0:1775764828.492890:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5000/0x6e98bd47ed523c8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd548a expref: 58 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.492930:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd548a expref: 57 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.492941:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:1.0:1775764828.492944:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764828.492948:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5800, rc 0) 00000100:00100000:1.0:1775764828.493013:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076127744:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 525us (739us total) trans 4294970688 rc 0/0 00000100:00100000:1.0:1775764828.493022:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6567 00000100:00100000:2.0:1775764828.501216:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.501315:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076128000 00000100:00100000:0.0:1775764828.501328:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076128000 00000100:00100000:0.0:1775764828.501391:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1731 00000100:00100000:0.0:1775764828.501399:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1862023076128000:12345-192.168.202.58@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1775764828.501433:0:8402:0:(ldlm_lib.c:1429:target_handle_connect()) lustre-OST0000: connection from 2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp t0 exp 0000000000000000 cur 1336 last 0 00000020:00000080:0.0:1775764828.501481:0:8402:0:(genops.c:1404:class_connect()) connect: client 2bb64567-481f-43c2-999a-8c9c071338ae, cookie 0x6e98bd47ed523ca4 00002000:00100000:0.0:1775764828.501493:0:8402:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli 2bb64567-481f-43c2-999a-8c9c071338ae/ffff96c1c1e88800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211334c ocd_grant: 32620544 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1775764828.501504:0:8402:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1775764828.501575:0:8402:0:(ofd_obd.c:388:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1775764828.501605:0:8402:0:(import.c:65:import_set_state_nolock()) ffff96c1c1e8f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1775764828.501679:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2407:x1862023076128000:12345-192.168.202.58@tcp:8:lhsmtool_posix.0 Request processed in 280us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.501688:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1731 00000100:00100000:2.0:1775764828.515408:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.515610:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076127872 00000100:00100000:0.0:1775764828.515620:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076127872 00000100:00100000:0.0:1775764828.515683:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 754 00000100:00100000:0.0:1775764828.515693:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+57:2411:x1862023076127872:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764828.515710:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764828.515734:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523c96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd548a expref: 57 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.515752:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:0.0:1775764828.515756:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764828.515872:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:2411:x1862023076127872:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 179us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.515880:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 754 00000100:00100000:2.0:1775764828.529983:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.530234:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076128128 00000100:00100000:0.0:1775764828.530245:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076128128 00000100:00100000:0.0:1775764828.530380:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1732 00000100:00100000:0.0:1775764828.530390:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:0:x1862023076128128:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1775764828.530442:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 3/1,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530461:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764828.530463:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764828.530468:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530483:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530507:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530516:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530523:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530531:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764828.530535:0:15167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530544:0:15167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530569:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.530577:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000176ba237/0x6e98bd47ed523cab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764828.530652:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:0:x1862023076128128:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 264us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.530661:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1732 00000100:00100000:0.0:1775764828.536141:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00080000:1.0:1775764828.536150:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764828.536212:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076128384 00000100:00100000:3.0:1775764828.536223:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076128384 00000100:00100000:3.0:1775764828.536284:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6568 00000100:00100000:3.0:1775764828.536295:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076128384:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764828.536428:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076128384:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 134us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.536436:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6568 00000100:00100000:3.0:1775764828.540800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.540910:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076128512 00000100:00100000:1.0:1775764828.540919:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076128512 00000100:00100000:1.0:1775764828.540968:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1733 00000100:00100000:1.0:1775764828.540974:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076128512:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764828.540993:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764828.541010:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9f1dae/0x6e98bd47ed523cb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5491 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.541033:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764828.541044:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764828.541053:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9f1dae/0x6e98bd47ed523cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5491 expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.541070:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9f1dae/0x6e98bd47ed523cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5491 expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.541096:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5000, rc 0) 00000100:00100000:1.0:1775764828.541160:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076128512:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 185us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.541165:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1733 00000100:00100000:3.0:1775764828.547076:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.549677:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076128768 00000100:00100000:1.0:1775764828.549690:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076128768 00000100:00100000:1.0:1775764828.549891:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6569 00000100:00100000:1.0:1775764828.549899:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076128768:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1775764828.553013:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076128768:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 3103us (5935us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.553024:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6569 00000100:00100000:1.0:1775764828.559189:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764828.559698:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076128896 00000100:00100000:0.0:1775764828.559709:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076128896 00000100:00100000:0.0:1775764828.559848:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6570 00000100:00100000:0.0:1775764828.559859:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+56:48878:x1862023076128896:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764828.559880:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764828.559902:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523cb9 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5498 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.559936:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.559951:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.559962:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.560098:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523cb9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 58 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.560119:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 57 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764828.560128:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:0.0:1775764828.560130:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764828.560134:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1200, rc 0) 00000100:00100000:0.0:1775764828.560191:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076128896:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 334us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764828.560199:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6570 00000100:00100000:3.0:1775764828.564510:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.565234:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076129024 00000100:00100000:1.0:1775764828.565246:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076129024 00000100:00100000:1.0:1775764828.565384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6571 00000100:00100000:1.0:1775764828.565397:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076129024:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764828.565438:0:6523:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764828.565570:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076129024:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 176us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.565578:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6571 00000100:00100000:0.0:1775764828.569403:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.569590:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076129152 00000100:00100000:3.0:1775764828.569603:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076129152 00000100:00100000:3.0:1775764828.569678:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1734 00000100:00100000:3.0:1775764828.569688:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076129152:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764828.569735:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.569753:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764828.569987:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764828.569996:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570013:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570057:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570065:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570087:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570095:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764828.570100:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570110:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570128:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764828.570137:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3b977f/0x6e98bd47ed523cc7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764828.570224:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076129152:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 535us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.570233:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1734 00000100:00100000:0.0:1775764828.572994:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.573195:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076129408 00000100:00100000:1.0:1775764828.573206:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076129408 00000100:00100000:1.0:1775764828.573267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6572 00000100:00100000:1.0:1775764828.573277:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076129408:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1775764828.573819:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.573841:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 57 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.573849:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.573887:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 57 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.573901:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 57 pid: 24980 timeout: 1436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764828.573915:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c55b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099820416:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764828.574006:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c63546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764828.584634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764828.584675:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076129536 00000100:00100000:1.0:1775764828.584684:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076129536 00010000:00010000:1.0:1775764828.584719:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 58 pid: 24980 timeout: 1436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764828.584755:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1420 00000100:00100000:1.0:1775764828.584789:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+58:2411:x1862023076129536:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764828.584805:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764828.584812:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 58 pid: 24980 timeout: 1436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.584833:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 58 pid: 24980 timeout: 1436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.584858:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:1.0:1775764828.584863:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.584874:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.584882:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764828.584900:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764828.584945:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+58:2411:x1862023076129536:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764828.584953:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1420 00010000:00010000:2.0:1775764828.585108:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523cc0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5498 expref: 57 pid: 24980 timeout: 1436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764828.585126:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c55b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099820416:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764828.585146:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585155:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585161:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585314:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585322:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585337:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585361:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764828.585367:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585375:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585384:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:2.0:1775764828.585387:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764828.585391:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764828.585397:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cce lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764828.585487:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076129408:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 12212us (12504us total) trans 4294970689 rc 0/0 00000100:00100000:2.0:1775764828.585496:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6572 00000040:00080000:1.0:1775764828.585728:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764828.585734:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764828.586289:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1775764828.586296:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764828.601299:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764828.601552:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076129792 00000100:00100000:3.0:1775764828.601563:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076129792 00000100:00100000:3.0:1775764828.601621:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1377 00000100:00100000:3.0:1775764828.601631:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:48878:x1862023076129792:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764828.601927:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+58:48878:x1862023076129792:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 295us (638us total) trans 4294970690 rc 0/0 00000100:00100000:3.0:1775764828.601936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1377 00000100:00100000:0.0:1775764828.981906:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099820544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764828.981981:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764828.982112:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099820544 00000100:00100000:3.0:1775764828.982121:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099820544 00000100:00100000:3.0:1775764828.982174:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1775764828.982183:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099820544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764828.982210:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764828.982256:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099820544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764828.982263:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1775764828.982593:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099820544:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1775764829.045007:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764829.045016:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764829.050207:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764829.050226:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1775764829.050427:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764829.318029:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318080:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318106:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318126:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318145:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318164:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.318214:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076129920 00000100:00100000:3.0:1775764829.318223:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076129920 00000100:00100000:3.0:1775764829.318284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 971 00000100:00100000:3.0:1775764829.318294:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076129920:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318379:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076129920:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318388:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 971 00000100:00100000:3.0:1775764829.318424:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130176 00000100:00100000:3.0:1775764829.318427:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130176 00000100:00100000:3.0:1775764829.318461:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130688 00000100:00100000:3.0:1775764829.318464:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130688 00000100:00100000:3.0:1775764829.318482:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130560 00000100:00100000:3.0:1775764829.318484:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130560 00000100:00100000:3.0:1775764829.318500:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1410 00000100:00100000:3.0:1775764829.318506:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076130176:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318532:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076130176:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318539:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1410 00000100:00100000:3.0:1775764829.318549:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1411 00000100:00100000:3.0:1775764829.318556:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076130688:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318576:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076130688:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 20us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318582:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1411 00000100:00100000:3.0:1775764829.318592:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1412 00000100:00100000:3.0:1775764829.318598:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076130560:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318619:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076130560:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 20us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318625:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1412 00000100:00100000:3.0:1775764829.318641:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130432 00000100:00100000:3.0:1775764829.318660:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130432 00000100:00100000:3.0:1775764829.318687:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130048 00000100:00100000:3.0:1775764829.318689:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130048 00000100:00100000:3.0:1775764829.318704:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130304 00000100:00100000:3.0:1775764829.318706:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130304 00000100:00100000:3.0:1775764829.318722:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1935 00000100:00100000:3.0:1775764829.318729:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076130432:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318758:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076130432:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318765:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1935 00000100:00100000:3.0:1775764829.318799:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1936 00000100:00100000:3.0:1775764829.318805:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076130048:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318827:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076130048:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318834:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1936 00000100:00100000:3.0:1775764829.318843:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1937 00000100:00100000:3.0:1775764829.318849:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:2408:x1862023076130304:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764829.318870:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:2408:x1862023076130304:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.318876:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1937 00000100:00080000:3.0:1775764829.319032:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764829.319038:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1775764829.325363:0:30962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764829.325371:0:30962:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764829.325400:0:30962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 152 count 3 00000040:00080000:0.0:1775764829.325412:0:30962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764829.434578:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764829.434671:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076130944 00000100:00100000:0.0:1775764829.434682:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076130944 00000100:00100000:0.0:1775764829.434743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6573 00000100:00100000:0.0:1775764829.434753:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48883:x1862023076130944:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:0.0:1775764829.434939:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].152, 136 off28656 00000100:00100000:0.0:1775764829.435019:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48883:x1862023076130944:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 267us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764829.435026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6573 00000100:00100000:1.0:1775764829.492340:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099820672:0@lo:400:kworker.0 00000100:00100000:1.0:1775764829.492440:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764829.497208:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764829.497236:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099820800:0@lo:400:kworker.0 00000100:00100000:1.0:1775764829.497342:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764829.497430:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099820672 00000100:00100000:1.0:1775764829.497440:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099820672 00000100:00100000:1.0:1775764829.497489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1775764829.497498:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764829.497551:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099820672:12345-0@lo:400:kworker.0 Request processed in 53us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764829.497558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1775764829.497605:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099820672:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.497679:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099820800 00000100:00100000:2.0:1775764829.497683:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099820800 00000100:00100000:2.0:1775764829.497724:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:2.0:1775764829.497731:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099820800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.497799:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099820800:12345-0@lo:400:kworker.0 Request processed in 69us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.497806:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1775764829.498092:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099820800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.501948:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099821056:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.502022:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.502211:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099820928:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.502244:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.502267:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099821440:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.502288:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.502305:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099821952:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.502326:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.502474:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099820928 00000100:00100000:2.0:1775764829.502482:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099820928 00000100:00100000:2.0:1775764829.502528:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1775764829.502537:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c55b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099820928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.502591:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c55b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099820928:12345-0@lo:400:kworker.0 Request processed in 55us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.502599:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1775764829.502637:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099820928:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.502889:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821056 00000100:00100000:2.0:1775764829.502894:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821056 00000100:00100000:2.0:1775764829.502967:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821440 00000100:00100000:2.0:1775764829.502988:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821440 00000100:00100000:2.0:1775764829.503048:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821952 00000100:00100000:2.0:1775764829.503052:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821952 00000100:00100000:2.0:1775764829.503083:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:2.0:1775764829.503090:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099821056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503125:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099821056:12345-0@lo:400:kworker.0 Request processed in 35us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.503131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:2.0:1775764829.503144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1775764829.503150:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099821440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503193:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099821440:12345-0@lo:400:kworker.0 Request processed in 44us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.503200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1775764829.503213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1775764829.503219:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099821952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503242:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099821952:12345-0@lo:400:kworker.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.503247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1775764829.503301:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099821312:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503361:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.503391:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099821824:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503429:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.503464:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1775764829.503483:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099821184:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503522:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.503555:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099821696:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503579:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.503597:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099822208:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503616:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764829.503682:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821312 00000100:00100000:2.0:1775764829.503697:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821312 00000100:00100000:2.0:1775764829.503740:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821824 00000100:00100000:2.0:1775764829.503757:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821824 00000100:00100000:2.0:1775764829.503818:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1775764829.503825:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099821312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503901:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099821312:12345-0@lo:400:kworker.0 Request processed in 76us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.503907:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1775764829.503921:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1775764829.503927:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099821824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.503986:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099821824:12345-0@lo:400:kworker.0 Request processed in 59us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.503993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1775764829.504026:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821184 00000100:00100000:2.0:1775764829.504029:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821184 00000100:00100000:2.0:1775764829.504069:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1775764829.504075:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099821184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.504107:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099821184:12345-0@lo:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.504112:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1775764829.504150:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099821440:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.504160:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099821952:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.504190:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099821184:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.504199:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099821312:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.504207:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099821824:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.505273:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099821056:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.505323:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099821568:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.505418:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764829.505460:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099822080:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.505509:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1775764829.505606:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764829.505613:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764829.505637:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821696 00000100:00100000:2.0:1775764829.506989:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822208 00000100:00100000:2.0:1775764829.507007:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822208 00000100:00100000:3.0:1775764829.507223:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821696 00000100:00100000:3.0:1775764829.507265:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099821568 00000100:00100000:3.0:1775764829.507269:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099821568 00000100:00100000:3.0:1775764829.507286:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822080 00000100:00100000:3.0:1775764829.507289:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822080 00000100:00100000:3.0:1775764829.507306:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1775764829.507314:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099821696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.507401:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099821696:12345-0@lo:400:kworker.0 Request processed in 86us (3819us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.507408:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1775764829.507425:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1775764829.507432:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099821568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.507462:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099821568:12345-0@lo:400:kworker.0 Request processed in 31us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.507467:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1775764829.507478:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1775764829.507483:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099822080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.507508:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099822080:12345-0@lo:400:kworker.0 Request processed in 26us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764829.507525:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00080000:3.0:1775764829.507551:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764829.507555:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764829.507591:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099821568:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.507602:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099822080:0@lo:400:kworker.0 00000100:00100000:3.0:1775764829.507637:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099821696:0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.507947:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1775764829.507956:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099822208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764829.508038:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099822208:12345-0@lo:400:kworker.0 Request processed in 83us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.508044:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1775764829.510311:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099822208:0@lo:400:kworker.0 00000040:00080000:1.0:1775764829.620363:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764829.620372:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764829.620403:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 153 count 4 00000040:00080000:1.0:1775764829.620410:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764829.620544:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099822336:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764829.620637:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c45cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1775764829.633919:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764829.633951:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076131072 00000100:00100000:2.0:1775764829.633962:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076131072 00000100:00100000:2.0:1775764829.634014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6574 00000100:00100000:2.0:1775764829.634023:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+59:48893:x1862023076131072:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764829.634079:0:6522:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9e:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1775764829.634202:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+59:48893:x1862023076131072:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 179us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764829.634210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6574 00000100:00100000:1.0:1775764829.642926:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099822336:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764829.645305:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764829.645426:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076131328 00000100:00100000:2.0:1775764829.645438:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076131328 00000100:00100000:2.0:1775764829.645495:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6575 00000100:00100000:2.0:1775764829.645505:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+58:48893:x1862023076131328:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764829.645527:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764829.645548:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523cd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd549f expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764829.645656:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523cdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764829.645672:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523cdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764829.645685:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523cdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764829.645712:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9e:0x0]: returning size 0 00010000:00010000:2.0:1775764829.645866:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523cd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd549f expref: 61 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764829.645883:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523cdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd549f expref: 60 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764829.645891:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:2.0:1775764829.645893:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764829.645896:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3800, rc 0) 00000100:00100000:2.0:1775764829.645962:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:48893:x1862023076131328:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 458us (666us total) trans 4294970691 rc 0/0 00000100:00100000:2.0:1775764829.645969:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6575 00000100:00100000:2.0:1775764829.666707:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764829.666791:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764829.666793:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076131712 00000100:00100000:3.0:1775764829.666805:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076131712 00000100:00100000:3.0:1775764829.666882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6576 00000100:00100000:3.0:1775764829.666895:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+60:48893:x1862023076131712:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1775764829.666898:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076131456 00000100:00100000:1.0:1775764829.666905:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076131456 00000100:00100000:1.0:1775764829.666955:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 755 00000100:00100000:1.0:1775764829.666964:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+61:2410:x1862023076131456:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764829.666978:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764829.666993:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764829.667002:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523cdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd549f expref: 61 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667012:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667035:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764829.667068:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:1.0:1775764829.667076:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764829.667141:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+60:2410:x1862023076131456:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 177us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764829.667150:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 755 00010000:00010000:3.0:1775764829.667212:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667219:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667226:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667240:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764829.667245:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667253:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667263:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:3.0:1775764829.667266:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764829.667271:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764829.667276:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523cea lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764829.667421:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+60:48893:x1862023076131712:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 529us (725us total) trans 4294970692 rc 0/0 00000100:00100000:3.0:1775764829.667429:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6576 00000040:00080000:1.0:1775764829.667729:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764829.667736:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764829.669091:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1775764829.669104:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764829.682625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764829.682746:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076131968 00000100:00100000:1.0:1775764829.682969:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076131968 00000100:00100000:1.0:1775764829.683177:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1378 00000100:00100000:1.0:1775764829.683189:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+60:48893:x1862023076131968:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764829.683453:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+61:48893:x1862023076131968:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 267us (840us total) trans 4294970693 rc 0/0 00000100:00100000:1.0:1775764829.683461:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1378 00000100:00100000:3.0:1775764830.003419:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099822464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764830.003487:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764830.003563:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822464 00000100:00100000:3.0:1775764830.003570:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822464 00000100:00100000:3.0:1775764830.003616:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1775764830.003626:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099822464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1775764830.003668:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:3.0:1775764830.003714:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099822464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764830.003734:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1775764830.003810:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099822464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764830.003975:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099822592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764830.004006:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764830.004036:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822592 00000100:00100000:2.0:1775764830.004040:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822592 00000100:00100000:2.0:1775764830.004078:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1775764830.004086:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099822592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764830.004096:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:2.0:1775764830.004126:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099822592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764830.004141:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1775764830.004173:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099822592:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1775764830.015466:0:8398:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2bb64567-481f-43c2-999a-8c9c071338ae 00000001:00100000:2.0:1775764830.015478:0:8398:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2bb64567-481f-43c2-999a-8c9c071338ae 00000020:00000080:2.0:1775764830.015482:0:8398:0:(genops.c:904:class_export_put()) final put ffff96c1c4dee000/2bb64567-481f-43c2-999a-8c9c071338ae 00000020:00000080:3.0:1775764830.015544:0:29880:0:(genops.c:863:class_export_destroy()) destroying export ffff96c1c4dee000/2bb64567-481f-43c2-999a-8c9c071338ae for lustre-OST0000 00000020:00000080:3.0:1775764830.015599:0:29880:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff96c1c4ded800 for lustre-OST0000 00010000:00010000:3.0:1775764830.075318:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764830.447210:0:31013:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764830.447221:0:31013:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764830.447252:0:31013:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 153 count 4 00000040:00080000:0.0:1775764830.447259:0:31013:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764830.576560:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764830.576650:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076132224 00000100:00100000:1.0:1775764830.576662:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076132224 00000100:00100000:1.0:1775764830.576739:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6577 00000100:00100000:1.0:1775764830.576750:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:48896:x1862023076132224:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764830.576798:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764830.576820:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523cf1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54a6 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764830.576930:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cf8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764830.576958:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764830.576971:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764830.576985:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9e:0x0]: returning size 0 00010000:00010000:1.0:1775764830.577096:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523cf1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54a6 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764830.577114:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54a6 expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764830.577124:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:1.0:1775764830.577127:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764830.577130:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4c00, rc 0) 00000100:00100000:1.0:1775764830.577187:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:48896:x1862023076132224:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 439us (638us total) trans 4294970694 rc 0/0 00000100:00100000:1.0:1775764830.577195:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6577 00000100:00080000:3.0:1775764830.577270:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764830.582507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764830.582547:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764830.582612:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076132352 00000100:00100000:2.0:1775764830.582623:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076132352 00000100:00100000:2.0:1775764830.582684:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6578 00000100:00100000:2.0:1775764830.582696:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:48896:x1862023076132352:12345-192.168.202.58@tcp:54:lfs.0 00010000:00010000:2.0:1775764830.582792:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582812:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582825:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582859:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582867:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582874:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582880:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764830.582885:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582906:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582919:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:2.0:1775764830.582922:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1775764830.582927:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764830.582934:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d06 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764830.583002:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:48896:x1862023076132352:12345-192.168.202.58@tcp:54:lfs.0 Request processed in 308us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764830.583009:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6578 00000100:00100000:3.0:1775764830.583091:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076132480 00000100:00100000:3.0:1775764830.583096:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076132480 00000100:00100000:3.0:1775764830.583139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 756 00000100:00100000:3.0:1775764830.583146:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2410:x1862023076132480:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764830.583158:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764830.583173:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523cf8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54a6 expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764830.583185:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9e:0x0].0x0 (ffff96c2c6356a00) 00010000:00010000:3.0:1775764830.583189:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764830.583207:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:2410:x1862023076132480:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 62us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764830.583214:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 756 00000100:00100000:2.0:1775764830.590016:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764830.590210:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076132736 00000100:00100000:3.0:1775764830.590225:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076132736 00000100:00100000:3.0:1775764830.590296:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1379 00000100:00100000:3.0:1775764830.590309:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df703050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:48896:x1862023076132736:12345-192.168.202.58@tcp:35:lfs.0 00000100:00100000:3.0:1775764830.590550:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df703050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:48896:x1862023076132736:12345-192.168.202.58@tcp:35:lfs.0 Request processed in 243us (544us total) trans 4294970695 rc 0/0 00000100:00100000:3.0:1775764830.590560:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1379 00010000:00010000:0.0:1775764831.090731:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764832.050304:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099822720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764832.050391:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764832.053259:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822720 00000100:00100000:2.0:1775764832.053274:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822720 00000100:00100000:2.0:1775764832.053347:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1775764832.053360:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099822720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1775764832.053405:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444220928 avail 1297981440 00000100:00100000:2.0:1775764832.053504:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099822720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764832.053511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1775764832.053582:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099822720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1775764832.117355:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764833.074488:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099822848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764833.074562:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764833.075196:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775764833.075207:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099822976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764833.075241:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764833.075812:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822848 00000100:00100000:1.0:1775764833.075832:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822848 00000100:00100000:1.0:1775764833.075887:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099822976 00000100:00100000:1.0:1775764833.075891:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099822976 00000100:00100000:1.0:1775764833.075910:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1775764833.075918:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099822848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764833.075948:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33968320 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764833.076028:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099822848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764833.076036:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1775764833.076053:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1775764833.076060:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099822976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764833.076069:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33968320 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764833.076093:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099822976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764833.076099:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1775764833.076142:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099822976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764833.076158:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099822848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1775764833.077526:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1775764833.142420:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764834.098376:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1775764834.098398:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099823104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764834.098467:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.098536:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823104 00000100:00100000:3.0:1775764834.098544:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823104 00000100:00100000:3.0:1775764834.098591:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1775764834.098599:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099823104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764834.098645:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764834.098686:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099823104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.098702:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1775764834.098743:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099823104:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1775764834.103149:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970695 is committed 00000001:00080000:1.0:1775764834.103185:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970693 is committed 00010000:00010000:0.0:1775764834.103279:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764834.103291:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764834.103298:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764834.103314:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764834.103319:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764834.103343:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764834.103361:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x55b14e68 (ffff96c2c6356800) 00010000:00010000:0.0:1775764834.103364:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764834.103369:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764834.103375:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523c03 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x16:0x0].0x55b14e68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103539:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103547:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103553:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103558:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764834.103561:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103575:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103585:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46b7907 (ffff96c2c6356600) 00010000:00010000:3.0:1775764834.103587:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764834.103590:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103595:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523ba8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x46b7907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103618:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103625:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103631:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103636:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764834.103639:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103645:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103652:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff96c2c6356100) 00010000:00010000:3.0:1775764834.103654:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764834.103657:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.103669:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523baf lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764834.162091:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764834.464735:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464836:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464890:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464926:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464942:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464959:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.464978:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764834.465007:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076132992 00000100:00100000:3.0:1775764834.465016:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076132992 00000100:00100000:3.0:1775764834.465071:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133504 00000100:00100000:3.0:1775764834.465074:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133504 00000100:00100000:3.0:1775764834.465092:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133120 00000100:00100000:3.0:1775764834.465095:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133120 00000100:00100000:3.0:1775764834.465110:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133632 00000100:00100000:3.0:1775764834.465113:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133632 00000100:00100000:3.0:1775764834.465127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1944 00000100:00100000:3.0:1775764834.465137:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:2409:x1862023076132992:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465272:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133248 00000100:00100000:1.0:1775764834.465277:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133248 00000100:00100000:1.0:1775764834.465313:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133760 00000100:00100000:1.0:1775764834.465316:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133760 00000100:00100000:1.0:1775764834.465334:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133376 00000100:00100000:1.0:1775764834.465336:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133376 00000100:00100000:1.0:1775764834.465346:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076133888 00000100:00100000:1.0:1775764834.465347:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076133888 00000100:00100000:1.0:1775764834.465360:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1417 00000100:00100000:1.0:1775764834.465366:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076133248:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465429:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076133248:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 63us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465437:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1417 00000100:00100000:1.0:1775764834.465469:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1418 00000100:00100000:1.0:1775764834.465475:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076133760:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465501:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076133760:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465507:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1418 00000100:00100000:1.0:1775764834.465516:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1419 00000100:00100000:1.0:1775764834.465522:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076133376:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465543:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076133376:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465549:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1419 00000100:00100000:1.0:1775764834.465559:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1420 00000100:00100000:1.0:1775764834.465565:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076133888:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465584:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076133888:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 20us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465589:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1420 00000100:00100000:1.0:1775764834.465608:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1945 00000100:00100000:1.0:1775764834.465614:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:2408:x1862023076133504:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465639:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:2408:x1862023076133504:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465645:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1945 00000100:00100000:1.0:1775764834.465658:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1946 00000100:00100000:1.0:1775764834.465664:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076133120:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465688:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076133120:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465701:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1946 00000100:00100000:1.0:1775764834.465715:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1947 00000100:00100000:1.0:1775764834.465720:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076133632:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764834.465744:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076133632:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.465750:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1947 00000100:00100000:3.0:1775764834.466022:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+50:2409:x1862023076132992:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 886us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.466030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1944 00000100:00100000:0.0:1775764834.467093:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076132864 00000100:00100000:0.0:1775764834.467103:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076132864 00000100:00100000:0.0:1775764834.467150:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 973 00000100:00100000:0.0:1775764834.467172:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d1202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076132864:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764834.467228:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d1202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076132864:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 71us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764834.467234:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 973 00000100:00080000:0.0:1775764834.467270:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764834.467275:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1775764834.467278:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764834.467280:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764834.610186:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099823360:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610259:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764834.610352:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099823872:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610374:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764834.610388:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099824384:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610407:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764834.610434:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1775764834.610439:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099823488:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610462:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764834.610481:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099824000:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610501:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764834.610513:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099824512:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610531:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764834.610560:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823488 00000100:00100000:2.0:1775764834.610567:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823488 00000100:00100000:2.0:1775764834.610616:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1775764834.610624:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099823488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.610673:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099823488:12345-0@lo:400:kworker.0 Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764834.610680:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1775764834.610721:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099823488:0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.610823:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823360 00000100:00100000:1.0:1775764834.610828:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823360 00000100:00100000:1.0:1775764834.610865:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823872 00000100:00100000:1.0:1775764834.610868:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823872 00000100:00100000:1.0:1775764834.610891:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824384 00000100:00100000:1.0:1775764834.610893:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824384 00000100:00100000:1.0:1775764834.610905:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824000 00000100:00100000:1.0:1775764834.610907:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824000 00000100:00100000:1.0:1775764834.610918:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824512 00000100:00100000:1.0:1775764834.610920:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824512 00000100:00100000:1.0:1775764834.610933:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1775764834.610939:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099823360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.610977:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099823360:12345-0@lo:400:kworker.0 Request processed in 38us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.610982:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1775764834.610993:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1775764834.610998:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099823872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.611021:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099823872:12345-0@lo:400:kworker.0 Request processed in 23us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.611027:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1775764834.611045:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1775764834.611050:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099824384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.611074:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099824384:12345-0@lo:400:kworker.0 Request processed in 24us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.611079:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1775764834.611088:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1775764834.611092:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099824000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.611114:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099824000:12345-0@lo:400:kworker.0 Request processed in 22us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.611119:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1775764834.611127:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1775764834.611131:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099824512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.611148:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099824512:12345-0@lo:400:kworker.0 Request processed in 17us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.611153:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1775764834.611371:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099823232:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611420:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611460:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099823744:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611482:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611500:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099824256:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611522:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611541:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099824768:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611561:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611582:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1775764834.611588:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099823616:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611609:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611625:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099824128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611642:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611655:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099824640:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611673:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764834.611699:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824256 00000100:00100000:3.0:1775764834.611704:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824256 00000100:00100000:3.0:1775764834.611730:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824768 00000100:00100000:3.0:1775764834.611733:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824768 00000100:00100000:3.0:1775764834.611751:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824128 00000100:00100000:3.0:1775764834.611753:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824128 00000100:00100000:3.0:1775764834.611762:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824640 00000100:00100000:3.0:1775764834.611764:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824640 00000100:00100000:3.0:1775764834.611805:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1775764834.611811:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5104e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099824256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611850:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5104e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099824256:12345-0@lo:400:kworker.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.611856:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1775764834.611875:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1775764834.611880:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099824768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611909:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099824768:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.611915:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1775764834.611926:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1775764834.611931:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099824128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611954:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099824128:12345-0@lo:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.611960:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1775764834.611970:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1775764834.611975:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099824640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.611998:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099824640:12345-0@lo:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.612004:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1775764834.612022:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823744 00000100:00100000:3.0:1775764834.612025:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823744 00000100:00100000:3.0:1775764834.612045:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1775764834.612050:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099823744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612079:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099823744:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.612098:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1775764834.612117:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823616 00000100:00100000:3.0:1775764834.612120:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823616 00000100:00100000:3.0:1775764834.612139:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1775764834.612144:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099823616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612182:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1862023099823616:12345-0@lo:400:kworker.0 Request processed in 37us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764834.612187:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1775764834.612221:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3664:1862023099823616:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612230:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099824128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612239:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099824640:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612248:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099823744:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612256:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099824256:0@lo:400:kworker.0 00000100:00100000:3.0:1775764834.612263:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099824768:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.613118:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099824000:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.613131:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099824512:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.613142:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099823360:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.613151:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099823872:0@lo:400:kworker.0 00000100:00100000:2.0:1775764834.613178:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099824384:0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.613285:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099823232 00000100:00100000:1.0:1775764834.613290:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099823232 00000100:00100000:1.0:1775764834.613357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1775764834.613365:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099823232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764834.613437:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099823232:12345-0@lo:400:kworker.0 Request processed in 73us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764834.613444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1775764834.614477:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099823232:0@lo:400:kworker.0 00000100:00080000:0.0:1775764834.614675:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764834.614682:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764834.614685:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764835.121988:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764835.122879:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099825024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764835.123060:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764835.123408:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099824896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764835.123437:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764835.123534:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099824896 00000100:00100000:3.0:1775764835.123534:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099825024 00000100:00100000:1.0:1775764835.123542:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099824896 00000100:00100000:3.0:1775764835.123542:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099825024 00000100:00100000:1.0:1775764835.123602:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1775764835.123611:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099824896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764835.123648:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:1.0:1775764835.123692:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099824896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764835.123699:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1775764835.123714:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1775764835.123720:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099825024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764835.123730:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886538752 avail 3655016448 00000100:00100000:1.0:1775764835.123753:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099825024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764835.123791:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1775764835.124705:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099825024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764835.124720:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099824896:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1775764835.185989:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764835.827384:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764835.827394:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764835.827486:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 153 count 3 00000040:00080000:0.0:1775764835.827494:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764836.003631:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764836.003704:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076134016 00000100:00100000:2.0:1775764836.003715:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076134016 00000100:00100000:2.0:1775764836.003861:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6579 00000100:00100000:2.0:1775764836.003872:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48862:x1862023076134016:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1775764836.004296:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+50:48862:x1862023076134016:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 418us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764836.004305:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6579 00000100:00080000:0.0:1775764836.004492:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764836.016221:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764836.019914:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076134144 00000100:00100000:3.0:1775764836.019935:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076134144 00000100:00100000:3.0:1775764836.020047:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6580 00000100:00100000:3.0:1775764836.020061:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:48862:x1862023076134144:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1775764836.020203:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:48862:x1862023076134144:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 146us (3993us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764836.020211:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6580 00000100:00080000:0.0:1775764836.020528:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1775764836.213562:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764837.174952:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1775764837.174978:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099825152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1775764837.175060:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764837.175700:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099825152 00000100:00100000:3.0:1775764837.175710:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099825152 00000100:00100000:3.0:1775764837.175797:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1775764837.175808:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099825152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764837.175851:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444220928 avail 1297981440 00000100:00100000:3.0:1775764837.175918:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099825152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764837.175926:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1775764837.176477:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099825152:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1775764837.233950:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1775764837.923926:0:31210:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 16:00:35 (1775764835) 00000100:00100000:1.0:1775764838.194828:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099825280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764838.197230:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764838.197348:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099825408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764838.197383:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764838.197425:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099825280 00000100:00100000:1.0:1775764838.197434:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099825280 00000100:00100000:1.0:1775764838.197490:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099825408 00000100:00100000:1.0:1775764838.197494:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099825408 00000100:00100000:1.0:1775764838.197513:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1775764838.197520:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099825280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764838.197561:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33968320 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764838.197605:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099825280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764838.197612:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1775764838.197628:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1775764838.197635:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099825408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764838.197644:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33968320 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764838.197670:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099825408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764838.197676:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:1.0:1775764838.197694:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764838.197727:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099825408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1775764838.205052:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099825280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1775764838.262682:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764838.267685:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764838.267694:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764838.268238:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764838.268248:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764839.218278:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099825536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764839.218368:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764839.218495:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099825536 00000100:00100000:3.0:1775764839.218504:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099825536 00000100:00100000:3.0:1775764839.218557:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1775764839.218567:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099825536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764839.218601:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764839.218656:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099825536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764839.218663:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1775764839.218711:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099825536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764839.231464:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.232172:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076134400 00000100:00100000:2.0:1775764839.232187:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076134400 00000100:00100000:3.0:1775764839.232403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6581 00000100:00100000:3.0:1775764839.232415:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+50:49521:x1862023076134400:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764839.232437:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764839.232458:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232541:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232567:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232581:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232598:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232621:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232628:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232748:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523d22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232759:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523d22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232764:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523d22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764839.232805:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1775764839.232921:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232928:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232933:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232939:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232945:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764839.232948:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232965:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232978:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:3.0:1775764839.232981:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764839.232985:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.232990:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233003:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233008:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233013:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233018:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764839.233020:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233025:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233031:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c1c2a04800) 00010000:00010000:3.0:1775764839.233033:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764839.233035:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233050:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233328:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54ad expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233344:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523d22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54ad expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.233351:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764839.233354:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764839.233356:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764839.233434:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+52:49521:x1862023076134400:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1022us (1982us total) trans 4294970696 rc 0/0 00000100:00100000:3.0:1775764839.233442:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6581 00000100:00080000:1.0:1775764839.235152:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764839.236220:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.236307:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.236391:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076134784 00000100:00100000:0.0:1775764839.236402:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076134784 00000100:00100000:0.0:1775764839.236466:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 757 00000100:00100000:0.0:1775764839.236484:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+52:2408:x1862023076134784:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764839.236503:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764839.236526:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523d22 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54ad expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.236545:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764839.236551:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764839.236628:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:2408:x1862023076134784:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 146us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.236636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 757 00000100:00100000:3.0:1775764839.244135:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076134656 00000100:00100000:3.0:1775764839.244149:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076134656 00000100:00100000:3.0:1775764839.244322:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1380 00000100:00100000:3.0:1775764839.244333:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:49521:x1862023076134656:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764839.245436:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+52:49521:x1862023076134656:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 1099us (9217us total) trans 4294970697 rc 0/0 00000100:00100000:2.0:1775764839.245447:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1380 00000100:00100000:1.0:1775764839.261214:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.261325:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076134912 00000100:00100000:0.0:1775764839.261365:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076134912 00000100:00100000:0.0:1775764839.261497:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6582 00000100:00100000:0.0:1775764839.261509:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:49521:x1862023076134912:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1775764839.261645:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:49521:x1862023076134912:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 137us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.261653:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6582 00000100:00100000:0.0:1775764839.267108:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.267231:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135040 00000100:00100000:2.0:1775764839.267244:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135040 00000100:00100000:2.0:1775764839.267407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6583 00000100:00100000:2.0:1775764839.267419:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:49522:x1862023076135040:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764839.267462:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.267494:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54b4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267566:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267583:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267596:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267610:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267618:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267624:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267670:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267677:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267693:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267700:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267713:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.267717:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267724:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267739:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764839.267742:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.267747:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267754:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523d37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267810:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267827:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267833:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267839:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.267841:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267855:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267873:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae759fa4 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.267876:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.267879:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267885:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267921:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54b4 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267931:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764839.267934:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.267937:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54b4 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.267945:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2a00, rc 0) 00000100:00100000:2.0:1775764839.268005:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:49522:x1862023076135040:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 588us (907us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764839.268014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6583 00000100:00080000:1.0:1775764839.269552:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764839.277304:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.277649:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135168 00000100:00100000:3.0:1775764839.277660:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135168 00000100:00080000:1.0:1775764839.277800:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764839.277896:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6584 00000100:00100000:3.0:1775764839.277906:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:49521:x1862023076135168:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1775764839.278012:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:49521:x1862023076135168:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 107us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764839.278037:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6584 00000040:00080000:2.0:1775764839.282092:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764839.282102:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1775764839.283588:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764839.284676:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764839.284699:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764839.291041:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.291188:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135424 00000100:00100000:2.0:1775764839.291198:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135424 00000100:00100000:2.0:1775764839.291337:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6585 00000100:00100000:2.0:1775764839.291374:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+40:49522:x1862023076135424:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:2.0:1775764839.291440:0:10088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764839.291487:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523c3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5467 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.291517:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764839.291522:0:10088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764839.291584:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.291598:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.291605:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.291638:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.291652:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 51 pid: 6522 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764839.291668:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099825664:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764839.292132:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c416ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1775764839.294236:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099825664:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764839.294280:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764839.295602:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.296204:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135552 00000100:00100000:2.0:1775764839.296215:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135552 00010000:00010000:2.0:1775764839.296271:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 52 pid: 6522 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764839.296317:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1421 00000100:00100000:2.0:1775764839.296326:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+52:2411:x1862023076135552:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764839.296441:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764839.296450:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 52 pid: 6522 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.296464:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 52 pid: 6522 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.296810:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523bbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5444 expref: 52 pid: 6522 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.297241:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764839.297246:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.297265:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.297273:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.297371:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764839.297455:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076135552:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 1129us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.297463:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1421 00010000:00010000:3.0:1775764839.302155:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.302174:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.302208:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.302222:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.302233:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.309654:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.309677:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.309691:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764839.310587:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000011314df9 reply state 000000001b6e315d transno 4294970698 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310602:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310611:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.310613:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764839.310618:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1775764839.310624:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00010000:00010000:2.0:1775764839.310634:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310641:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310648:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310654:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.310658:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310682:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310700:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764839.310702:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.310706:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310711:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523d45 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764839.310725:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000011314df9 reply state 000000001b6e315d transno 4294970698 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310734:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.310740:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae759fa4 (ffff96c1c2a04800) 00010000:00010000:2.0:1775764839.310742:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764839.310744:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1775764839.310934:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:49522:x1862023076135424:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 19554us (19893us total) trans 4294970698 rc 0/0 00000100:00100000:2.0:1775764839.310945:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6585 00000100:00100000:0.0:1775764839.329078:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.330451:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135680 00000100:00100000:2.0:1775764839.330465:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135680 00000100:00100000:0.0:1775764839.331192:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6586 00000100:00100000:0.0:1775764839.331204:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:49523:x1862023076135680:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:0.0:1775764839.331231:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764839.331253:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54bb expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.331354:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed523d61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.331369:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed523d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.331381:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed523d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764839.331440:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1775764839.331444:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764839.331488:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed523d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.331528:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54bb expref: 43 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.331549:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed523d61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54bb expref: 42 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.332062:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764839.332066:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764839.332071:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0a00, rc 0) 00000100:00100000:0.0:1775764839.332150:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:49523:x1862023076135680:12345-192.168.202.58@tcp:101:bash.0 Request processed in 947us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.332158:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6586 00000100:00100000:3.0:1775764839.335750:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.336122:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135808 00000100:00100000:1.0:1775764839.336134:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135808 00000100:00100000:1.0:1775764839.336184:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6587 00000100:00100000:1.0:1775764839.336193:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:49523:x1862023076135808:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:1.0:1775764839.336214:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764839.336247:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523d68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336325:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336339:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336362:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336373:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336380:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336386:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336466:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523d7d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336474:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523d7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336481:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523d7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764839.336513:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:1.0:1775764839.336517:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764839.336576:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523d7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336596:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336602:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336608:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336614:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336620:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764839.336624:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336631:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336645:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764839.336648:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.336653:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336659:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523d6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336675:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336681:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336705:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336711:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764839.336713:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336720:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336728:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae759fa4 (ffff96c1c2a04800) 00010000:00010000:1.0:1775764839.336731:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.336734:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336739:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523d76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336790:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523d68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54c2 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336806:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5c00/0x6e98bd47ed523d7d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54c2 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.336813:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764839.336816:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1775764839.336827:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5c00, rc 0) 00000100:00100000:1.0:1775764839.337287:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:49523:x1862023076135808:12345-192.168.202.58@tcp:101:bash.0 Request processed in 1093us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.337306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6587 00000100:00100000:0.0:1775764839.342635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.344075:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076135936 00000100:00100000:3.0:1775764839.344090:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076135936 00000100:00100000:3.0:1775764839.344153:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6588 00000100:00100000:3.0:1775764839.344163:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:49523:x1862023076135936:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:3.0:1775764839.344183:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764839.344203:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d84 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54c9 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344288:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344303:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344331:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344346:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344353:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344360:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344396:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344403:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344409:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344415:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764839.344419:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344427:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344440:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764839.344442:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764839.344447:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344460:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9000/0x6e98bd47ed523d8b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344474:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344480:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344485:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344490:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764839.344493:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344499:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344506:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c2a04100) 00010000:00010000:3.0:1775764839.344509:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764839.344511:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344516:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523d92 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344550:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d84 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54c9 expref: 44 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344587:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764839.344589:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764839.344593:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523d84 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54c9 expref: 44 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.344603:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764839.344695:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:49523:x1862023076135936:12345-192.168.202.58@tcp:101:bash.0 Request processed in 534us (2072us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764839.344704:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6588 00000100:00100000:3.0:1775764839.360756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.361505:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136064 00000100:00100000:2.0:1775764839.361528:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136064 00000100:00100000:2.0:1775764839.361621:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6589 00000100:00100000:2.0:1775764839.361634:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:49524:x1862023076136064:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764839.361680:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.361715:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54d0 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.363087:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.363108:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.363121:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764839.363174:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1775764839.363179:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764839.363204:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.363241:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 53 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.363281:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 52 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.363305:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764839.363308:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764839.363313:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9200, rc 0) 00000100:00100000:3.0:1775764839.365080:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:49524:x1862023076136064:12345-192.168.202.58@tcp:101:rm.0 Request processed in 3438us (4324us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764839.365091:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6589 00000100:00100000:2.0:1775764839.381452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.381731:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136192 00000100:00100000:0.0:1775764839.381742:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136192 00000100:00100000:0.0:1775764839.381857:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6590 00000100:00100000:0.0:1775764839.381867:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:49524:x1862023076136192:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:0.0:1775764839.381890:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764839.381916:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523da7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54d7 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382353:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382370:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382404:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382417:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382423:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382428:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382613:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523dbc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382622:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523dbc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.382629:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523dbc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764839.382663:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:0.0:1775764839.382668:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764839.382761:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523dbc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383199:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383208:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383230:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383236:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764839.383241:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383250:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383274:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764839.383277:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764839.383282:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383288:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523dae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383304:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383311:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383315:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.383320:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764839.383323:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.384166:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.384185:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae759fa4 (ffff96c1c2a04800) 00010000:00010000:0.0:1775764839.384188:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764839.384192:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.384199:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523db5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.384244:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523da7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d7 expref: 54 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.384271:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1200/0x6e98bd47ed523dbc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d7 expref: 53 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.384279:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764839.384281:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1775764839.384284:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1200, rc 0) 00000100:00100000:0.0:1775764839.385233:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+53:49524:x1862023076136192:12345-192.168.202.58@tcp:101:rm.0 Request processed in 3361us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.385244:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6590 00000100:00100000:1.0:1775764839.389727:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.390565:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136320 00000100:00100000:2.0:1775764839.390702:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136320 00000100:00100000:2.0:1775764839.390819:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6591 00000100:00100000:2.0:1775764839.390830:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+53:49524:x1862023076136320:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764839.390854:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.390998:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523dc3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54de expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391083:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391100:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391114:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391129:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391136:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391143:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391206:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391213:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391219:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391225:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391231:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.391236:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391243:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391295:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.391298:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.391303:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391310:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dca lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391325:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391331:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391346:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391351:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.391354:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391359:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391367:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c7207b00) 00010000:00010000:2.0:1775764839.391369:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.391372:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391377:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523dd1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391418:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523dc3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54de expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391429:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.391431:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.391434:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523dc3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54de expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.391444:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3e00, rc 0) 00000100:00100000:2.0:1775764839.391531:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+53:49524:x1862023076136320:12345-192.168.202.58@tcp:101:rm.0 Request processed in 703us (1814us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764839.391549:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6591 00000100:00100000:3.0:1775764839.401614:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.401933:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136448 00000100:00100000:1.0:1775764839.401944:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136448 00000100:00100000:1.0:1775764839.402006:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6592 00000100:00100000:1.0:1775764839.402015:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:49524:x1862023076136448:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764839.402035:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764839.402057:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523dd8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54e5 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402118:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402133:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402145:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402158:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402165:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402171:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402207:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402228:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402234:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402240:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402354:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764839.402359:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402366:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402378:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764839.402381:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.402386:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402392:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523ddf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402406:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402412:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402417:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402428:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764839.402431:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402436:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402443:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c2c7ea7e00) 00010000:00010000:1.0:1775764839.402445:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.402447:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402453:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523de6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402488:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523dd8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54e5 expref: 54 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402498:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764839.402500:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.402503:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523dd8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54e5 expref: 54 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.402511:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4c00, rc 0) 00000100:00100000:1.0:1775764839.402605:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:49524:x1862023076136448:12345-192.168.202.58@tcp:101:rm.0 Request processed in 591us (1000us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764839.402612:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6592 00000100:00100000:3.0:1775764839.431231:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.431604:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136576 00000100:00100000:2.0:1775764839.431613:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136576 00000100:00100000:2.0:1775764839.431659:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6593 00000100:00100000:2.0:1775764839.431666:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+53:49525:x1862023076136576:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764839.431684:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.431700:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523ded lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54ec expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.431756:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432123:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432131:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432145:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432152:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432158:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432196:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432217:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432222:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432226:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.432229:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432234:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432244:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.432246:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.432251:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432266:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523df4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432280:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432286:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432292:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432297:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.432306:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432312:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432319:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c7207b00) 00010000:00010000:2.0:1775764839.432320:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.432322:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432326:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523dfb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432355:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523ded lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54ec expref: 54 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432362:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.432363:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.432365:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed523ded lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54ec expref: 54 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.432371:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3e00, rc 0) 00000100:00100000:2.0:1775764839.432427:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+53:49525:x1862023076136576:12345-192.168.202.58@tcp:101:cp.0 Request processed in 762us (1208us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764839.432433:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6593 00000100:00100000:2.0:1775764839.439376:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.439481:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136704 00000100:00100000:0.0:1775764839.439493:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136704 00000100:00100000:0.0:1775764839.439568:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6594 00000100:00100000:0.0:1775764839.439579:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+53:49525:x1862023076136704:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764839.439625:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764839.439648:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523e02 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54f3 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439721:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439739:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439752:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439813:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439820:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439827:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439867:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439874:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439881:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439886:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764839.439897:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439904:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439916:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764839.439919:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764839.439923:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439929:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523e09 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439942:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439947:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439952:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439956:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764839.439959:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439964:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439971:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c2c6356b00) 00010000:00010000:0.0:1775764839.439973:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764839.439982:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.439988:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523e10 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.440023:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523e02 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54f3 expref: 54 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.440033:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764839.440035:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764839.440039:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523e02 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54f3 expref: 54 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.440047:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1600, rc 0) 00000100:00100000:0.0:1775764839.440117:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+53:49525:x1862023076136704:12345-192.168.202.58@tcp:101:cp.0 Request processed in 539us (752us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764839.440124:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6594 00000100:00100000:3.0:1775764839.443508:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.443621:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076136960 00000100:00100000:2.0:1775764839.443632:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076136960 00000100:00100000:2.0:1775764839.443689:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6595 00000100:00100000:2.0:1775764839.443713:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+53:49525:x1862023076136960:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764839.443738:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.443759:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523e17 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd54fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.443894:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.443910:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.443921:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.443936:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.443943:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.443949:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1775764839.444283:0:6523:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x57:0x0], index 1: 0 00010000:00010000:2.0:1775764839.444433:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444442:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444450:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444495:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444503:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444509:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444515:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444521:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764839.444526:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444533:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444547:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.444549:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764839.444555:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 3/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.444561:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523e1e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764839.444575:0:6523:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000512a1c8a reply state 00000000c14177a4 transno 4294970699 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.445607:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.445630:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c7207b00) 00010000:00010000:2.0:1775764839.445632:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764839.445637:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1775764839.445688:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed523e17 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.445707:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.445715:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:2.0:1775764839.445717:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764839.445720:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3000, rc 0) 00000100:00100000:2.0:1775764839.446207:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+56:49525:x1862023076136960:12345-192.168.202.58@tcp:101:cp.0 Request processed in 2492us (2705us total) trans 4294970699 rc 0/0 00000100:00100000:2.0:1775764839.446217:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6595 00000100:00100000:2.0:1775764839.451566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.451902:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137088 00000100:00100000:3.0:1775764839.451918:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137088 00000100:00080000:1.0:1775764839.452201:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764839.452280:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1735 00000100:00100000:2.0:1775764839.452293:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076137088:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764839.452316:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.452339:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5501 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764839.452367:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1775764839.452389:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764839.452391:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764839.452400:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.452427:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.452443:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2c00, rc 0) 00000100:00100000:2.0:1775764839.452513:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076137088:12345-192.168.202.58@tcp:101:cp.0 Request processed in 224us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.452521:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1735 00000100:00100000:1.0:1775764839.457247:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.457370:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137216 00000100:00100000:2.0:1775764839.457381:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137216 00000100:00100000:2.0:1775764839.457447:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1736 00000100:00100000:2.0:1775764839.457457:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:49525:x1862023076137216:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764839.457480:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.457501:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5508 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.457534:0:15167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.457543:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764839.457546:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764839.457674:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 9 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.457715:0:15167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.457750:0:15167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 9 pid: 15167 timeout: 1447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764839.457764:0:15167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7234700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099825792:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764839.457934:0:15167:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b44300 going to sleep for 11 seconds 00000100:00100000:0.0:1775764839.462079:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.462165:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137344 00000100:00100000:3.0:1775764839.462178:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137344 00010000:00010000:3.0:1775764839.462228:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 10 pid: 15167 timeout: 1447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764839.462284:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1422 00000100:00100000:3.0:1775764839.462296:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076137344:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764839.462316:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764839.462341:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 10 pid: 15167 timeout: 1447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.462358:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 10 pid: 15167 timeout: 1447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.462412:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764839.462414:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764839.462423:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 10 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.462434:0:6506:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 10 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764839.462474:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 10 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764839.462491:0:6506:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff821880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1862023099825920:192.168.202.58@tcp:105: 00000100:00100000:3.0:1775764839.462602:0:6506:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c56553c0 going to sleep for 11 seconds 00010000:00010000:2.0:1775764839.463450:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef8208e/0x6e98bd47ed523e3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5501 expref: 10 pid: 15167 timeout: 1447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764839.463467:0:15167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7234700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099825792:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764839.463490:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 9 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.463501:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3a00, rc 0) 00000100:00100000:2.0:1775764839.463565:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:49525:x1862023076137216:12345-192.168.202.58@tcp:101:cp.0 Request processed in 6109us (6327us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.463578:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1736 00000100:00100000:0.0:1775764839.468332:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.469835:0:6506:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff821880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1862023099825920:192.168.202.58@tcp:105: 00010000:00010000:3.0:1775764839.469867:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764839.469952:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076137344:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 7656us (7883us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764839.469964:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1422 00000100:00100000:1.0:1775764839.471590:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137600 00000100:00100000:1.0:1775764839.471604:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137600 00000100:00100000:1.0:1775764839.471724:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1381 00000100:00100000:1.0:1775764839.471736:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+56:49525:x1862023076137600:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:1.0:1775764839.472068:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+57:49525:x1862023076137600:12345-192.168.202.58@tcp:35:cp.0 Request processed in 334us (3746us total) trans 4294970700 rc 0/0 00000100:00100000:1.0:1775764839.472076:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1381 00000100:00100000:0.0:1775764839.532992:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.533099:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137728 00000100:00100000:1.0:1775764839.533111:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137728 00000100:00100000:1.0:1775764839.533179:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6596 00000100:00100000:1.0:1775764839.533191:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:49528:x1862023076137728:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764839.533215:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764839.533239:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523e48 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd550f expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533320:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533335:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533347:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533358:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533366:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533392:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533477:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533484:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533491:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764839.533536:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9f:0x0]: returning size 1516 00000004:00200000:1.0:1775764839.533540:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764839.533573:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533585:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533594:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533601:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533607:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533613:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533630:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa5800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764839.533635:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533643:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533656:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764839.533659:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.533664:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533669:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523e4f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533685:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533690:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533694:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533699:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2c2fa4c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764839.533701:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533706:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533724:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c7207b00) 00010000:00010000:1.0:1775764839.533726:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764839.533728:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533734:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e56 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533761:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523e48 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd550f expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533832:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd550f expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.533841:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:1.0:1775764839.533843:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764839.533846:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4a00, rc 0) 00000100:00100000:1.0:1775764839.533913:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49528:x1862023076137728:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 725us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.533921:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6596 00000100:00100000:3.0:1775764839.540723:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.540850:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137856 00000100:00100000:1.0:1775764839.540862:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137856 00000100:00100000:1.0:1775764839.540925:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1737 00000100:00100000:1.0:1775764839.540934:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076137856:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764839.540953:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764839.540978:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7bfa2aa/0x6e98bd47ed523e64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5516 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764839.541059:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099826048:192.168.202.58@tcp:106: 00000100:00100000:1.0:1775764839.541150:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c71499c0 going to sleep for 11 seconds 00000100:00080000:0.0:1775764839.541205:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1775764839.545065:0:8402:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1775764839.545074:0:8402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb mtime: 0 -> 1775764839 00002000:00010000:1.0:1775764839.545076:0:8402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb atime: 0 -> 1775764839 00002000:00010000:1.0:1775764839.545078:0:8402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb ctime: 0 -> 1775764839 00002000:00010000:1.0:1775764839.545080:0:8402:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1775764839.545104:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099826048:192.168.202.58@tcp:106: 00010000:00010000:1.0:1775764839.545144:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7bfa2aa/0x6e98bd47ed523e64 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5516 expref: 10 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.545168:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7bfa2aa/0x6e98bd47ed523e64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5516 expref: 10 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.545181:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4c00, rc 0) 00000100:00100000:1.0:1775764839.545264:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2409:x1862023076137856:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 4321us (4539us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764839.545273:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1737 00000100:00100000:3.0:1775764839.554479:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.555088:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076137984 00000100:00100000:2.0:1775764839.555099:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076137984 00000100:00100000:2.0:1775764839.555166:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6597 00000100:00100000:2.0:1775764839.555176:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49528:x1862023076137984:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764839.555198:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764839.555222:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523e6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd551d expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.555332:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.555361:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.555373:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764839.555414:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1775764839.555418:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764839.555442:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.555468:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed523e6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 46 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.555502:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 45 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.555512:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764839.555515:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764839.555519:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2800, rc 0) 00000100:00100000:2.0:1775764839.555946:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49528:x1862023076137984:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 770us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.555955:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6597 00000100:00100000:3.0:1775764839.562925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.563085:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138240 00000100:00100000:1.0:1775764839.563098:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138240 00000100:00100000:1.0:1775764839.563166:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1954 00000100:00100000:1.0:1775764839.563179:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+57:2411:x1862023076138240:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764839.563297:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+57:2411:x1862023076138240:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 122us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.563326:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1954 00000100:00100000:3.0:1775764839.563835:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.563876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.563949:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138496 00000100:00100000:1.0:1775764839.563954:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138496 00000100:00100000:1.0:1775764839.564006:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1425 00000100:00100000:1.0:1775764839.564013:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076138496:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764839.564053:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076138496:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.564060:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1425 00000100:00080000:0.0:1775764839.564209:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764839.564277:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.564316:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.564368:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.564408:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076139008 00000100:00100000:0.0:1775764839.564413:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076139008 00000100:00100000:0.0:1775764839.564451:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1426 00000100:00100000:0.0:1775764839.564457:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076139008:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764839.564489:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076139008:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.564504:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1426 00000100:00080000:0.0:1775764839.564522:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764839.564630:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138112 00000100:00100000:1.0:1775764839.564634:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138112 00000100:00100000:1.0:1775764839.564669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 975 00000100:00100000:1.0:1775764839.564676:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076138112:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764839.564709:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076138112:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.564715:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 975 00000100:00100000:3.0:1775764839.567333:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.567373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.567426:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138624 00000100:00100000:0.0:1775764839.567436:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138624 00000100:00100000:0.0:1775764839.567492:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1427 00000100:00100000:0.0:1775764839.567501:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076138624:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764839.567574:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076138624:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.567600:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1427 00000100:00100000:2.0:1775764839.571248:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138752 00000100:00100000:2.0:1775764839.571276:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138752 00000100:00100000:2.0:1775764839.571379:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138368 00000100:00100000:2.0:1775764839.571382:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138368 00000100:00100000:2.0:1775764839.571420:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1955 00000100:00100000:2.0:1775764839.571430:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2411:x1862023076138752:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764839.571533:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2411:x1862023076138752:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 104us (7654us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.571541:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1955 00000100:00100000:2.0:1775764839.571560:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1956 00000100:00100000:2.0:1775764839.571567:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076138368:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764839.571747:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076138368:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 179us (7377us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.571752:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1956 00000100:00100000:3.0:1775764839.572342:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.572421:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076139136 00000100:00100000:0.0:1775764839.572428:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076139136 00000100:00100000:0.0:1775764839.572473:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1738 00000100:00100000:0.0:1775764839.572481:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076139136:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764839.572495:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764839.572515:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed523e79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5524 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764839.572590:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099826176:192.168.202.58@tcp:106: 00000100:00100000:0.0:1775764839.572707:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff9e5180 going to sleep for 11 seconds 00000100:00100000:2.0:1775764839.572952:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076138880 00000100:00100000:2.0:1775764839.572957:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076138880 00000100:00100000:2.0:1775764839.573011:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1957 00000100:00100000:2.0:1775764839.573018:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076138880:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764839.573065:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076138880:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 48us (5691us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.573072:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1957 00000100:00080000:0.0:1775764839.573484:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764839.582830:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099826176:192.168.202.58@tcp:106: 00010000:00010000:0.0:1775764839.582888:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed523e79 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5524 expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.582920:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed523e79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5524 expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.582961:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0400, rc 0) 00000100:00100000:0.0:1775764839.583053:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076139136:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 10570us (10710us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764839.583065:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1738 00000100:00100000:2.0:1775764839.590373:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.590526:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076139392 00000100:00100000:1.0:1775764839.590537:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076139392 00000100:00100000:1.0:1775764839.590610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6598 00000100:00100000:1.0:1775764839.590621:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49528:x1862023076139392:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:1.0:1775764839.590840:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].153, 136 off28792 00000100:00100000:1.0:1775764839.590928:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49528:x1862023076139392:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 308us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.590937:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6598 00000100:00100000:2.0:1775764839.730231:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099826432:0@lo:400:kworker.0 00000100:00100000:1.0:1775764839.730271:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099826688:0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.730360:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099826304:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.731879:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764839.731902:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099826560:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.731946:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099826944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732040:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764839.732060:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099827456:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732088:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764839.732118:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764839.732146:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099827200:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732171:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764839.732190:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099827712:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732210:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764839.732337:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099826432 00000100:00100000:2.0:1775764839.732345:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099826432 00000100:00100000:2.0:1775764839.732388:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099826944 00000100:00100000:2.0:1775764839.732391:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099826944 00000100:00100000:2.0:1775764839.732417:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099827456 00000100:00100000:2.0:1775764839.732419:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099827456 00000100:00100000:2.0:1775764839.732438:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099826688 00000100:00100000:2.0:1775764839.732442:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099826688 00000100:00100000:2.0:1775764839.732456:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1775764839.732463:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099826432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732531:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099826432:12345-0@lo:400:kworker.0 Request processed in 68us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.732539:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1775764839.732568:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1775764839.732574:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099826944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732604:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099826944:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.732610:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1775764839.732635:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1775764839.732640:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099827456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732665:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099827456:12345-0@lo:400:kworker.0 Request processed in 25us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.732677:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1775764839.732688:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1775764839.732694:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099826688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732724:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099826688:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.732731:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1775764839.732750:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099827200 00000100:00100000:2.0:1775764839.732754:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099827200 00000100:00100000:2.0:1775764839.732793:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099827712 00000100:00100000:2.0:1775764839.732796:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099827712 00000100:00100000:2.0:1775764839.732816:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1775764839.732822:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099827200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732852:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099827200:12345-0@lo:400:kworker.0 Request processed in 30us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.732858:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1775764839.732868:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1775764839.732874:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099827712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732897:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099827712:12345-0@lo:400:kworker.0 Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.732903:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1775764839.732936:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099826688:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732948:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099827200:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.732956:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099827712:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.733010:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099826944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.733029:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099827456:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.733038:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099826432:0@lo:400:kworker.0 00000100:00080000:2.0:1775764839.733095:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1775764839.733100:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764839.737310:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764839.737391:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099827072:0@lo:400:kworker.0 00000100:00100000:1.0:1775764839.737447:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764839.737469:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099827584:0@lo:400:kworker.0 00000100:00100000:1.0:1775764839.737488:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764839.737541:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099827072 00000100:00100000:1.0:1775764839.737549:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099827072 00000100:00100000:1.0:1775764839.737591:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099827584 00000100:00100000:1.0:1775764839.737593:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099827584 00000100:00100000:1.0:1775764839.737619:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1775764839.737626:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099827072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764839.737672:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099827072:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.737678:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1775764839.737692:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1775764839.737697:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099827584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764839.737717:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099827584:12345-0@lo:400:kworker.0 Request processed in 20us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.737722:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00080000:1.0:1775764839.737737:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764839.737764:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099827072:0@lo:400:kworker.0 00000100:00100000:1.0:1775764839.737786:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099827584:0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.740461:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099826560 00000100:00100000:2.0:1775764839.740477:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099826560 00000100:00100000:2.0:1775764839.740539:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1775764839.740540:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764839.740549:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099826560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.740575:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099826304 00000100:00100000:0.0:1775764839.740578:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099826304 00000100:00100000:0.0:1775764839.740604:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1775764839.740610:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099826304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764839.740616:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099826560:12345-0@lo:400:kworker.0 Request processed in 70us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764839.740623:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1775764839.740635:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099826304:12345-0@lo:400:kworker.0 Request processed in 26us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.740640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1775764839.740694:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099826304:0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.740706:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099826816:0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.740736:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764839.740765:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099827328:0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.740801:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764839.740823:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099826816 00000100:00100000:0.0:1775764839.740826:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099826816 00000100:00100000:0.0:1775764839.740857:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099827328 00000100:00100000:0.0:1775764839.740860:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099827328 00000100:00100000:0.0:1775764839.740878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1775764839.740884:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099826816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.740923:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099826816:12345-0@lo:400:kworker.0 Request processed in 40us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.740929:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1775764839.740955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1775764839.740960:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099827328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.740986:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099827328:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.740991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1775764839.741016:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099827328:0@lo:400:kworker.0 00000100:00100000:0.0:1775764839.741044:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099826816:0@lo:400:kworker.0 00000100:00080000:1.0:1775764839.741481:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764839.741511:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099826560:0@lo:400:kworker.0 00000040:00080000:0.0:1775764839.928795:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764839.928807:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764839.928844:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 154 count 4 00000040:00080000:0.0:1775764839.928864:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764839.929102:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099827840:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1775764839.929208:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff9e5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1775764839.938572:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764839.938663:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076139520 00000100:00100000:3.0:1775764839.938672:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076139520 00000100:00100000:3.0:1775764839.938731:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6599 00000100:00100000:3.0:1775764839.938742:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076139520:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764839.938811:0:6523:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764839.938934:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076139520:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 194us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764839.938943:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6599 00000100:00100000:0.0:1775764839.940100:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099827840:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764839.944204:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.944325:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076139776 00000100:00100000:1.0:1775764839.944337:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076139776 00000100:00100000:1.0:1775764839.944402:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6600 00000100:00100000:1.0:1775764839.944412:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+57:49538:x1862023076139776:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764839.944435:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764839.944457:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523e80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd552b expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.944593:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e87 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.944609:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e87 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.944624:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e87 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764839.944636:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x9f:0x0]: returning size 1516 00010000:00010000:1.0:1775764839.944749:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523e80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd552b expref: 60 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.944826:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e87 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd552b expref: 59 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.944837:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:1.0:1775764839.944840:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764839.944844:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa4c00, rc 0) 00000100:00100000:1.0:1775764839.945170:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076139776:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 758us (978us total) trans 4294970701 rc 0/0 00000100:00100000:1.0:1775764839.945206:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6600 00000100:00100000:1.0:1775764839.949504:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764839.949592:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076139904 00000100:00100000:2.0:1775764839.949602:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076139904 00000100:00100000:2.0:1775764839.949652:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1739 00000100:00100000:2.0:1775764839.949662:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076139904:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1775764839.949709:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.949730:0:15167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 8 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.949738:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1775764839.949740:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1775764839.949743:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.949834:0:15167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 8 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764839.949847:0:15167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 8 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764839.949868:0:15167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099827968:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764839.949945:0:15167:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b44300 going to sleep for 11 seconds 00000100:00100000:3.0:1775764839.956420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764839.956516:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076140032 00000100:00100000:0.0:1775764839.956529:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076140032 00000100:00100000:0.0:1775764839.956619:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 758 00000100:00100000:0.0:1775764839.956630:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+59:2408:x1862023076140032:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764839.956646:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764839.956672:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523e87 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd552b expref: 59 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.956714:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:0.0:1775764839.956719:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764839.956818:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+58:2408:x1862023076140032:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 190us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.956826:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 758 00000100:00100000:3.0:1775764839.959986:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.960089:0:8408:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076140160 00000100:00100000:1.0:1775764839.960100:0:8408:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076140160 00002000:00100000:1.0:1775764839.960157:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x57:0x0] (0->1515) req@ffff96c2ff821180 x1862023076140160/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:320/0 lens 2008/0 e 0 to 0 dl 1775764850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764839.960168:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2ff821180 with x1862023076140160 ext(0->1515) 00010000:00010000:1.0:1775764839.960177:0:8408:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 9 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.960193:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 9 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764839.960201:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c2ff821180 00000100:00100000:1.0:1775764839.960237:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 34 00000100:00100000:1.0:1775764839.960257:0:8408:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076140160:12345-192.168.202.58@tcp:4:cp.0 00000100:00100000:0.0:1775764839.961042:0:15167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099827968:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764839.961071:0:15167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764839.963421:0:8408:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+11:2410:x1862023076140160:12345-192.168.202.58@tcp:4:cp.0 Request processed in 3161us (3432us total) trans 4294967729 rc 0/0 00000100:00100000:1.0:1775764839.963437:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 34 00002000:00100000:1.0:1775764839.963452:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x57:0x0] (0->1515) req@ffff96c2ff821180 x1862023076140160/t4294967729(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:320/0 lens 2008/448 e 0 to 0 dl 1775764850 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764839.963463:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2ff821180 with x1862023076140160 ext(0->1515) 00010000:00010000:1.0:1775764839.963474:0:8408:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 11 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.963517:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 11 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764839.963525:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c2ff821180 00000100:00100000:3.0:1775764839.972914:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764839.973533:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076140288 00000100:00100000:1.0:1775764839.973547:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076140288 00010000:00010000:1.0:1775764839.973589:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 11 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764839.973631:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1423 00000100:00100000:1.0:1775764839.973641:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+11:2411:x1862023076140288:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764839.973662:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1775764839.973682:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x57:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1775764839.973690:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 11 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.973705:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 11 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.973732:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71ac8de/0x6e98bd47ed523e41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5508 expref: 11 pid: 15167 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.973751:0:8419:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764839.973754:0:8419:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764839.973760:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.973864:0:8419:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764839.973892:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764839.973954:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076140288:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 315us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764839.973962:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1423 00010000:00010000:0.0:1775764839.974126:0:15167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974137:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974157:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974164:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974171:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974189:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764839.974193:0:15167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974203:0:15167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974214:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764839.974220:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d48b4a95/0x6e98bd47ed523e95 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764839.974302:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076139904:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 24640us (24809us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764839.974311:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1739 00000100:00100000:3.0:1775764840.007723:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.009084:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076140544 00000100:00100000:0.0:1775764840.009099:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076140544 00000100:00100000:0.0:1775764840.009184:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6601 00000100:00100000:0.0:1775764840.009195:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076140544:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764840.009339:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076140544:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 144us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764840.009346:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6601 00000100:00100000:1.0:1775764840.034947:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.035128:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076140672 00000100:00100000:3.0:1775764840.035139:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076140672 00000100:00100000:3.0:1775764840.035201:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1740 00000100:00100000:3.0:1775764840.035211:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076140672:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764840.035230:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764840.035258:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5532 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764840.035286:0:8403:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x57:0x0] initial LVB size: 1516, mtime: 0x69d80567, atime: 0x0, ctime: 0x69d80567, blocks: 0x8 00010000:00010000:3.0:1775764840.035307:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764840.035310:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764840.035333:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.035354:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.035370:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9000, rc 0) 00000100:00100000:3.0:1775764840.035433:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076140672:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 224us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764840.035442:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1740 00000100:00100000:1.0:1775764840.041901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.043556:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076140928 00000100:00100000:2.0:1775764840.043571:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076140928 00000100:00100000:2.0:1775764840.043634:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6602 00000100:00100000:2.0:1775764840.043646:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076140928:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1775764840.043793:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076140928:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 128us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764840.043801:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6602 00000100:00100000:0.0:1775764840.056284:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.056373:0:25201:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076141056 00000100:00100000:3.0:1775764840.056384:0:25201:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076141056 00002000:00100000:3.0:1775764840.056436:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x57:0x0] (0->4095) req@ffff96c2f98c7b80 x1862023076141056/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:321/0 lens 488/0 e 0 to 0 dl 1775764851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764840.056448:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2f98c7b80 with x1862023076141056 ext(0->4095) 00002000:00010000:3.0:1775764840.056454:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c2f98c7b80 00000100:00100000:3.0:1775764840.056501:0:25201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 436 00000100:00100000:3.0:1775764840.056511:0:25201:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076141056:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1775764840.056694:0:25201:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076141056:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 183us (415us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1775764840.056702:0:25201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 436 00002000:00100000:3.0:1775764840.056709:0:25201:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x57:0x0] (0->4095) req@ffff96c2f98c7b80 x1862023076141056/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:321/0 lens 488/4536 e 0 to 0 dl 1775764851 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764840.056717:0:25201:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c2f98c7b80 with x1862023076141056 ext(0->4095) 00002000:00010000:3.0:1775764840.056720:0:25201:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c2f98c7b80 00000100:00100000:0.0:1775764840.070481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.070523:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076141184 00000100:00100000:0.0:1775764840.070535:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076141184 00000100:00100000:0.0:1775764840.070588:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6603 00000100:00100000:0.0:1775764840.070599:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+58:49538:x1862023076141184:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764840.070620:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.070641:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ea3 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5539 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.070676:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.070691:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.070703:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.070836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ea3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.070853:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.070861:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:0.0:1775764840.070863:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764840.070867:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0400, rc 0) 00000100:00100000:0.0:1775764840.070923:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076141184:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 326us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764840.070938:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6603 00000100:00100000:0.0:1775764840.086574:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.087882:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076141312 00000100:00100000:2.0:1775764840.087897:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076141312 00000100:00100000:2.0:1775764840.087969:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6604 00000100:00100000:2.0:1775764840.087980:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076141312:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764840.088013:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0x9f:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1775764840.088136:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076141312:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 158us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764840.088145:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6604 00000100:00100000:0.0:1775764840.092485:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.097337:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076141440 00000100:00100000:2.0:1775764840.097355:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076141440 00000100:00100000:2.0:1775764840.097437:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1741 00000100:00100000:2.0:1775764840.097445:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+10:2409:x1862023076141440:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1775764840.097487:0:8641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097503:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764840.097506:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764840.097511:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097526:0:8641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097551:0:8641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097559:0:8641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097567:0:8641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097573:0:8641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764840.097577:0:8641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097606:0:8641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097623:0:8641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.097631:0:8641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed523eb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764840.097712:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+10:2409:x1862023076141440:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 267us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764840.097718:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1741 00000100:00100000:1.0:1775764840.103666:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.104596:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076141696 00000100:00100000:3.0:1775764840.104608:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076141696 00000100:00100000:3.0:1775764840.104833:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6605 00000100:00100000:3.0:1775764840.104846:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076141696:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764840.104920:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.104938:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.104947:0:14288:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.104984:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.105001:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 59 pid: 6521 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764840.105024:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099828096:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764840.105121:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2f66c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764840.108239:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099828096:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764840.108284:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764840.109928:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.110014:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076141824 00000100:00100000:2.0:1775764840.110025:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076141824 00010000:00010000:2.0:1775764840.110066:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 60 pid: 6521 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764840.110099:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1424 00000100:00100000:2.0:1775764840.110109:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+60:2411:x1862023076141824:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764840.110126:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764840.110134:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 60 pid: 6521 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.110148:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 60 pid: 6521 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.110199:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523eaa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5539 expref: 60 pid: 6521 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.110214:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:2.0:1775764840.110218:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.110227:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.110235:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.110273:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764840.110338:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+59:2411:x1862023076141824:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 229us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764840.110346:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1424 00010000:00010000:3.0:1775764840.110701:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110711:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110887:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110897:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110904:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110910:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.110933:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110942:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110954:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:3.0:1775764840.110957:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764840.110960:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.110965:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523eb8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764840.111160:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076141696:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 6315us (7500us total) trans 4294970702 rc 0/0 00000100:00100000:2.0:1775764840.111169:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6605 00000040:00080000:0.0:1775764840.111397:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764840.111402:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764840.111937:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1775764840.111948:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764840.118514:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.123413:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142080 00000100:00100000:2.0:1775764840.123428:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142080 00000100:00100000:2.0:1775764840.123496:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1382 00000100:00100000:2.0:1775764840.123507:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:49538:x1862023076142080:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764840.123808:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+60:49538:x1862023076142080:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 302us (5304us total) trans 4294970703 rc 0/0 00000100:00100000:2.0:1775764840.123827:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1382 00000100:00100000:0.0:1775764840.244111:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099828224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764840.244191:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764840.244356:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099828352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764840.244386:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764840.244422:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099828224 00000100:00100000:2.0:1775764840.244430:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099828224 00000100:00100000:2.0:1775764840.244470:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099828352 00000100:00100000:2.0:1775764840.244473:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099828352 00000100:00100000:2.0:1775764840.244489:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1775764840.244496:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099828224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764840.244521:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510189760 pending 28672 free 3886538752 avail 3655016448 00000100:00100000:2.0:1775764840.244561:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099828224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764840.244569:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1775764840.244597:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1775764840.244604:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099828352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764840.244613:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510189760 pending 28672 free 3886538752 avail 3655016448 00000100:00100000:2.0:1775764840.244636:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099828352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764840.244643:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1775764840.244692:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099828352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764840.245455:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099828224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1775764840.305962:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764840.540001:0:31308:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764840.540012:0:31308:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764840.540061:0:31308:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 154 count 4 00000040:00080000:1.0:1775764840.540068:0:31308:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764840.600131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.600293:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142208 00000100:00100000:3.0:1775764840.600303:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142208 00000100:00100000:3.0:1775764840.600362:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6606 00000100:00100000:3.0:1775764840.600373:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49540:x1862023076142208:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:3.0:1775764840.600396:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764840.600421:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523ebf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5540 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600503:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600521:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600533:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600548:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600555:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600562:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600599:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600605:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600610:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600616:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600621:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.600631:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600638:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600650:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764840.600653:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.600657:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600663:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ec6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600676:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600683:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600688:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600693:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.600696:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600702:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600709:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764840.600711:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.600720:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600726:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523ecd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600761:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523ebf lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5540 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600805:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764840.600808:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.600812:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523ebf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5540 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.600822:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764840.600878:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49540:x1862023076142208:12345-192.168.202.58@tcp:101:bash.0 Request processed in 507us (757us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764840.600886:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6606 00000100:00100000:0.0:1775764840.622234:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.623631:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142336 00000100:00100000:3.0:1775764840.623649:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142336 00000100:00100000:3.0:1775764840.623724:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6607 00000100:00100000:3.0:1775764840.623735:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+60:49541:x1862023076142336:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764840.623767:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764840.623809:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523ed4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5547 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.623887:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.623915:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.623941:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.623957:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.623964:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.623970:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624009:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624016:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624154:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624161:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624167:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.624172:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624180:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624199:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764840.624202:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.624207:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624213:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523edb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624227:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624252:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624258:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624264:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.624267:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624273:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624282:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764840.624284:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.624287:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624293:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ee2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624339:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523ed4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5547 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624350:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764840.624352:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.624355:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523ed4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5547 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.624364:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764840.624432:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+60:49541:x1862023076142336:12345-192.168.202.58@tcp:101:rm.0 Request processed in 699us (2208us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764840.624441:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6607 00000100:00100000:3.0:1775764840.627310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.639997:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142464 00000100:00100000:0.0:1775764840.640025:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142464 00000100:00100000:0.0:1775764840.640101:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6608 00000100:00100000:0.0:1775764840.640114:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+60:49541:x1862023076142464:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:0.0:1775764840.640137:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.640158:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523ee9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd554e expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640233:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640275:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640288:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640321:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640329:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640336:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640375:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640382:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640388:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640394:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.640399:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640406:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640418:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764840.640421:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.640426:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640431:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523ef0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640451:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640457:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640463:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640469:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.640472:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640478:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640486:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c2c6356c00) 00010000:00010000:0.0:1775764840.640488:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.640491:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640497:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523ef7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640528:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523ee9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd554e expref: 61 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640538:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764840.640540:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.640549:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed523ee9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd554e expref: 61 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.640558:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1800, rc 0) 00000100:00100000:0.0:1775764840.640627:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+60:49541:x1862023076142464:12345-192.168.202.58@tcp:101:rm.0 Request processed in 516us (13328us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764840.640635:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6608 00000100:00100000:0.0:1775764840.675529:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.686007:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142592 00000100:00100000:2.0:1775764840.686032:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142592 00000100:00100000:2.0:1775764840.686102:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6609 00000100:00100000:2.0:1775764840.686112:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+60:49542:x1862023076142592:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764840.686138:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764840.686158:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523efe lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5555 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686227:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686252:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686263:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686279:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686285:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686292:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686328:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686335:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686342:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686347:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764840.686358:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686365:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686378:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764840.686382:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764840.686386:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686392:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523f05 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686403:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686409:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686414:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686420:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764840.686422:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686428:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686435:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c1c7207e00) 00010000:00010000:2.0:1775764840.686437:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764840.686446:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686452:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed523f0c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686485:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523efe lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5555 expref: 61 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686495:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764840.686498:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764840.686501:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed523efe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5555 expref: 61 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.686511:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2c00, rc 0) 00000100:00100000:2.0:1775764840.686571:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+60:49542:x1862023076142592:12345-192.168.202.58@tcp:101:cp.0 Request processed in 459us (11051us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764840.686578:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6609 00000100:00100000:0.0:1775764840.692128:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.692365:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142720 00000100:00100000:3.0:1775764840.692377:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142720 00000100:00100000:3.0:1775764840.692445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6610 00000100:00100000:3.0:1775764840.692455:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+60:49542:x1862023076142720:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764840.692482:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764840.692507:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523f13 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd555c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692593:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692612:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692641:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692658:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692665:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692672:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692710:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692716:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692735:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692742:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692748:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.692753:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692761:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692803:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764840.692812:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.692819:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692826:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523f1a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692841:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692846:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692850:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692855:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.692857:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692862:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692869:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764840.692871:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.692873:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692878:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523f21 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692917:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523f13 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd555c expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692936:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764840.692938:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.692942:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523f13 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd555c expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.692951:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764840.693099:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+60:49542:x1862023076142720:12345-192.168.202.58@tcp:101:cp.0 Request processed in 565us (902us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764840.693109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6610 00000100:00100000:3.0:1775764840.696179:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.698089:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076142976 00000100:00100000:0.0:1775764840.698106:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076142976 00000100:00100000:0.0:1775764840.698187:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6611 00000100:00100000:0.0:1775764840.698199:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+60:49542:x1862023076142976:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764840.698225:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.698270:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523f28 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5563 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.698389:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.698407:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 44 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.698414:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 4/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.698450:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 44 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.698483:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 44 pid: 10088 timeout: 1448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764840.698497:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099828480:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764840.698602:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b48a80 going to sleep for 11 seconds 00000100:00100000:3.0:1775764840.703410:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099828480:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764840.703448:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764840.704137:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.705087:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076143104 00000100:00100000:0.0:1775764840.705099:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076143104 00010000:00010000:0.0:1775764840.705144:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 45 pid: 10088 timeout: 1448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764840.705185:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1425 00000100:00100000:0.0:1775764840.705195:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2410:x1862023076143104:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764840.705211:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764840.705218:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 45 pid: 10088 timeout: 1448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705231:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 45 pid: 10088 timeout: 1448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705264:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed523e72 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd551d expref: 45 pid: 10088 timeout: 1448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705281:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764840.705285:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705310:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705317:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705346:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764840.705409:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2410:x1862023076143104:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 215us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764840.705417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1425 00010000:00010000:0.0:1775764840.705535:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705543:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705566:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705577:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.705589:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1775764840.706001:0:24980:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x57:0x0], index 0: 0 00010000:00010000:0.0:1775764840.706145:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706155:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706172:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706213:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706220:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706225:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706231:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706236:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.706252:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706260:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706270:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764840.706273:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.706277:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 3/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706284:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed523f2f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1775764840.706297:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008ac4bcb9 reply state 000000006c8cd679 transno 4294970704 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706313:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706320:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c2c6356c00) 00010000:00010000:0.0:1775764840.706322:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1775764840.706325:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1775764840.706362:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed523f28 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 63 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706378:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 62 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.706386:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:0.0:1775764840.706389:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764840.706391:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d400, rc 0) 00000100:00100000:0.0:1775764840.707696:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+63:49542:x1862023076142976:12345-192.168.202.58@tcp:101:cp.0 Request processed in 9490us (11519us total) trans 4294970704 rc 0/0 00000100:00100000:0.0:1775764840.707706:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6611 00000100:00100000:3.0:1775764840.716189:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.716274:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076143232 00000100:00100000:0.0:1775764840.716286:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076143232 00000100:00100000:0.0:1775764840.716352:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1742 00000100:00100000:0.0:1775764840.716363:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076143232:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764840.716389:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.716414:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd556a expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764840.716441:0:8402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1775764840.716468:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764840.716471:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764840.716480:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.716498:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.716512:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d800, rc 0) 00000100:00100000:0.0:1775764840.716581:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076143232:12345-192.168.202.58@tcp:101:cp.0 Request processed in 220us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764840.716589:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1742 00000100:00100000:0.0:1775764840.723209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.723285:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076143360 00000100:00100000:3.0:1775764840.723297:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076143360 00000100:00100000:3.0:1775764840.723356:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1743 00000100:00100000:3.0:1775764840.723366:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:49542:x1862023076143360:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764840.723386:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764840.723406:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5571 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.723445:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.723465:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764840.723468:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764840.723473:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.723511:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.723526:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 1448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764840.723552:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099828608:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764840.723639:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d88380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764840.740694:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099828608:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764840.740734:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.740758:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:1.0:1775764840.740863:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:49542:x1862023076143360:12345-192.168.202.58@tcp:101:cp.0 Request processed in 17497us (17660us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764840.740873:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1743 00000100:00100000:1.0:1775764840.742445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764840.742512:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076143488 00000100:00100000:2.0:1775764840.742522:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076143488 00010000:00010000:2.0:1775764840.742578:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 1448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764840.742620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1426 00000100:00100000:2.0:1775764840.742630:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076143488:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764840.742645:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764840.742668:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 1448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.742699:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 1448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.742725:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a01247c2/0x6e98bd47ed523f4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd556a expref: 8 pid: 8402 timeout: 1448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.742741:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764840.742744:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764840.742751:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.742761:0:6505:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764840.742838:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764840.742853:0:6505:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2df69c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1862023099828736:192.168.202.58@tcp:105: 00000100:00100000:2.0:1775764840.742923:0:6505:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20540 going to sleep for 11 seconds 00000100:00100000:3.0:1775764840.752262:0:6505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2df69c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1862023099828736:192.168.202.58@tcp:105: 00010000:00010000:3.0:1775764840.752288:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764840.752390:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076143488:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 9760us (9954us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764840.752402:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1426 00000100:00100000:3.0:1775764840.752572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.752603:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076143744 00000100:00100000:3.0:1775764840.752610:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076143744 00000100:00100000:3.0:1775764840.752658:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1383 00000100:00100000:3.0:1775764840.752667:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+63:49542:x1862023076143744:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:3.0:1775764840.752976:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+64:49542:x1862023076143744:12345-192.168.202.58@tcp:35:cp.0 Request processed in 309us (404us total) trans 4294970705 rc 0/0 00000100:00100000:3.0:1775764840.752993:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1383 00000100:00100000:2.0:1775764840.845842:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.847500:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076143872 00000100:00100000:0.0:1775764840.847512:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076143872 00000100:00100000:0.0:1775764840.847578:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6612 00000100:00100000:0.0:1775764840.847589:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49545:x1862023076143872:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764840.847609:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.847631:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523f59 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5578 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847703:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847720:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847732:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847752:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847793:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847801:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847880:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847890:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.847897:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764840.847935:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa0:0x0]: returning size 1516 00000004:00200000:0.0:1775764840.847940:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764840.848168:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848180:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848188:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848195:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848211:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848217:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.848221:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848229:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848250:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764840.848254:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.848258:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848265:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed523f60 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848276:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848281:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848287:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848292:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.848295:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848309:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848316:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c2c6356c00) 00010000:00010000:0.0:1775764840.848318:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.848321:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848327:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523f67 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848353:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523f59 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5578 expref: 46 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848365:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5578 expref: 45 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.848373:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:0.0:1775764840.848375:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1775764840.848377:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c400, rc 0) 00000100:00100000:0.0:1775764840.848458:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49545:x1862023076143872:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 871us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764840.848466:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6612 00000100:00100000:2.0:1775764840.861874:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.862111:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076144000 00000100:00100000:0.0:1775764840.862122:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076144000 00000100:00100000:0.0:1775764840.862182:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1744 00000100:00100000:0.0:1775764840.862193:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2409:x1862023076144000:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764840.862224:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.862261:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed523f75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd557f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764840.862325:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099828864:192.168.202.58@tcp:106: 00000100:00100000:0.0:1775764840.862422:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b48300 going to sleep for 11 seconds 00002000:00010000:0.0:1775764840.864984:0:8405:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1775764840.864993:0:8405:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb mtime: 0 -> 1775764840 00002000:00010000:0.0:1775764840.864995:0:8405:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb atime: 0 -> 1775764840 00002000:00010000:0.0:1775764840.864998:0:8405:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb ctime: 0 -> 1775764840 00002000:00010000:0.0:1775764840.865000:0:8405:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1775764840.865022:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099828864:192.168.202.58@tcp:106: 00010000:00010000:0.0:1775764840.865057:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed523f75 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd557f expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.865083:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed523f75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd557f expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.865095:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6de00, rc 0) 00000100:00100000:0.0:1775764840.865144:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2409:x1862023076144000:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 2952us (3278us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764840.865153:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1744 00000100:00100000:3.0:1775764840.869528:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764840.869719:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076144128 00000100:00100000:1.0:1775764840.869733:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076144128 00000100:00100000:1.0:1775764840.869823:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6613 00000100:00100000:1.0:1775764840.869836:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49545:x1862023076144128:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764840.869862:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764840.869884:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523f7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5586 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.870459:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.870477:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.870491:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764840.870538:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:1.0:1775764840.870542:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764840.870566:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.870598:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523f7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.870620:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764840.870630:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764840.870650:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764840.870654:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5800, rc 0) 00000100:00100000:1.0:1775764840.870737:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:49545:x1862023076144128:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 903us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764840.870745:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6613 00000100:00100000:2.0:1775764840.880905:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764840.880977:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076144256 00000100:00100000:0.0:1775764840.880989:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076144256 00000100:00100000:0.0:1775764840.881050:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1745 00000100:00100000:0.0:1775764840.881060:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076144256:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764840.881096:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764840.881114:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed523f8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd558d expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764840.881180:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099828992:192.168.202.58@tcp:106: 00000100:00100000:0.0:1775764840.881277:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b48300 going to sleep for 11 seconds 00000100:00100000:0.0:1775764840.889336:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1862023099828992:192.168.202.58@tcp:106: 00010000:00010000:0.0:1775764840.889377:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed523f8a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd558d expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.889552:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001528e540/0x6e98bd47ed523f8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd558d expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.889566:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6de00, rc 0) 00000100:00100000:0.0:1775764840.889852:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076144256:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 8792us (8956us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764840.889871:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1745 00000100:00100000:0.0:1775764840.902364:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764840.902474:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076144512 00000100:00100000:3.0:1775764840.902487:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076144512 00000100:00100000:3.0:1775764840.902560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6614 00000100:00100000:3.0:1775764840.902571:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:49545:x1862023076144512:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:3.0:1775764840.902742:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].154, 136 off28928 00000100:00100000:3.0:1775764840.902868:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:49545:x1862023076144512:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 298us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764840.902876:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6614 00000001:00080000:1.0:1775764840.905699:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970705 is committed 00000001:00080000:1.0:1775764840.905753:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970698 is committed 00010000:00010000:3.0:1775764840.905943:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.905945:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.905956:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.905964:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.905988:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.905993:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906001:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906018:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae759fa4 (ffff96c1c2a04800) 00010000:00010000:0.0:1775764840.906021:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.906027:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906032:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed523d4c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae759fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906052:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906059:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906065:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906071:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764840.906074:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906079:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906098:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764840.906100:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764840.906103:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764840.906109:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed523d53 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906252:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906259:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906264:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.906267:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906273:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906283:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c7207b00) 00010000:00010000:3.0:1775764840.906286:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.906297:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906303:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed523e25 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906321:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906338:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906344:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906349:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764840.906351:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906357:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906365:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c2c6356c00) 00010000:00010000:3.0:1775764840.906368:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764840.906371:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764840.906375:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed523f36 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1775764841.144629:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764841.144639:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764841.144678:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 155 count 5 00000040:00080000:3.0:1775764841.144686:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764841.145174:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099829120:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1775764841.145292:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c8551540 going to sleep for 11 seconds 00000100:00100000:3.0:1775764841.158619:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099829120:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1775764841.158931:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764841.159134:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076144640 00000100:00100000:3.0:1775764841.159141:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076144640 00000100:00100000:3.0:1775764841.159218:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6615 00000100:00100000:3.0:1775764841.159229:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:49555:x1862023076144640:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764841.159278:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa0:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764841.159391:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:49555:x1862023076144640:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 163us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764841.159399:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6615 00000100:00080000:0.0:1775764841.160670:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764841.169908:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764841.177171:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076144896 00000100:00100000:1.0:1775764841.177189:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076144896 00000100:00100000:1.0:1775764841.177269:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6616 00000100:00100000:1.0:1775764841.177281:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+53:49555:x1862023076144896:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764841.177308:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764841.177498:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523f91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5594 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.177749:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523f98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.177767:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523f98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.177909:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523f98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764841.178196:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa0:0x0]: returning size 1516 00010000:00010000:1.0:1775764841.178468:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4c00/0x6e98bd47ed523f91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5594 expref: 56 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.178496:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523f98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5594 expref: 55 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.178524:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:1.0:1775764841.178526:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764841.178530:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2c2fa5a00, rc 0) 00000100:00100000:1.0:1775764841.180357:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076144896:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 3068us (10448us total) trans 4294970706 rc 0/0 00000100:00100000:1.0:1775764841.180369:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6616 00000100:00100000:0.0:1775764841.205216:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764841.205296:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764841.205330:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076145152 00000100:00100000:0.0:1775764841.205340:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076145152 00000100:00100000:0.0:1775764841.205412:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 759 00000100:00100000:0.0:1775764841.205423:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:2410:x1862023076145152:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764841.205438:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764841.205465:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5a00/0x6e98bd47ed523f98 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5594 expref: 55 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764841.205486:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:0.0:1775764841.205492:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764841.205545:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:2410:x1862023076145152:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 124us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764841.205552:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 759 00000100:00100000:3.0:1775764841.205801:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076145024 00000100:00100000:3.0:1775764841.205807:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076145024 00000100:00080000:0.0:1775764841.206352:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764841.216377:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1746 00000100:00100000:1.0:1775764841.216404:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076145024:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1775764841.216488:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.216513:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.216523:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1775764841.216526:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1775764841.216530:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.216571:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.216587:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 7 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764841.216625:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099829248:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764841.216747:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c7149780 going to sleep for 11 seconds 00000100:00100000:0.0:1775764841.224599:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099829248:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764841.224631:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764841.225649:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764841.225798:0:8410:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076145280 00000100:00100000:0.0:1775764841.225808:0:8410:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076145280 00002000:00100000:0.0:1775764841.225859:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x57:0x0] (0->1515) req@ffff96c1c7445c00 x1862023076145280/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:322/0 lens 2008/0 e 0 to 0 dl 1775764852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764841.225871:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c7445c00 with x1862023076145280 ext(0->1515) 00010000:00010000:0.0:1775764841.225880:0:8410:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 8 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764841.225895:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 8 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764841.225902:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c7445c00 00000100:00100000:0.0:1775764841.225938:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 35 00000100:00100000:0.0:1775764841.225947:0:8410:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076145280:12345-192.168.202.58@tcp:4:cp.0 00000100:00100000:0.0:1775764841.228513:0:8410:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076145280:12345-192.168.202.58@tcp:4:cp.0 Request processed in 2557us (2859us total) trans 4294967729 rc 0/0 00000100:00100000:0.0:1775764841.228527:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 35 00002000:00100000:0.0:1775764841.230189:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x57:0x0] (0->1515) req@ffff96c1c7445c00 x1862023076145280/t4294967729(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:322/0 lens 2008/448 e 0 to 0 dl 1775764852 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764841.230203:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c7445c00 with x1862023076145280 ext(0->1515) 00010000:00010000:0.0:1775764841.230231:0:8410:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 10 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764841.230261:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 10 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764841.230270:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c7445c00 00000100:00100000:2.0:1775764841.242234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764841.242486:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076145408 00000100:00100000:3.0:1775764841.242497:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076145408 00010000:00010000:3.0:1775764841.242551:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 10 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764841.242598:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1427 00000100:00100000:3.0:1775764841.242608:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+10:2409:x1862023076145408:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764841.242623:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1775764841.242642:0:25199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x57:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1775764841.242650:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 10 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.242686:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 10 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.242715:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523f52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5571 expref: 10 pid: 8403 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.242742:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764841.242745:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764841.242750:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.242760:0:25199:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.251512:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764841.252255:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252275:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252309:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252318:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252336:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252343:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764841.252347:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252356:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252399:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.252407:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fd7505a/0x6e98bd47ed523fa6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764841.252518:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076145024:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 36123us (47308us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764841.252529:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1746 00000100:00100000:3.0:1775764841.254120:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076145408:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 11506us (11889us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764841.254132:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1427 00000100:00100000:3.0:1775764841.256189:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764841.258145:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076145664 00000100:00100000:1.0:1775764841.258160:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076145664 00000100:00100000:1.0:1775764841.258228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6617 00000100:00100000:1.0:1775764841.258250:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+54:49555:x1862023076145664:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1775764841.258924:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+54:49555:x1862023076145664:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 684us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764841.258934:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6617 00000100:00100000:2.0:1775764841.269119:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764841.269683:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076145792 00000100:00100000:1.0:1775764841.269694:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076145792 00000100:00100000:1.0:1775764841.269760:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1747 00000100:00100000:1.0:1775764841.269796:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076145792:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764841.269816:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764841.269840:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd559b expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764841.269885:0:8641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x57:0x0] initial LVB size: 1516, mtime: 0x69d80568, atime: 0x0, ctime: 0x69d80568, blocks: 0x8 00010000:00010000:1.0:1775764841.269905:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764841.269908:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764841.269917:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 9 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.269946:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 9 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.269969:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403f400, rc 0) 00000100:00100000:1.0:1775764841.270037:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+9:2409:x1862023076145792:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 268us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764841.270045:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1747 00000100:00100000:1.0:1775764841.276060:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764841.276253:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146048 00000100:00100000:3.0:1775764841.276265:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146048 00000100:00100000:3.0:1775764841.276339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6618 00000100:00100000:3.0:1775764841.276350:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:49555:x1862023076146048:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764841.277493:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:49555:x1862023076146048:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 1137us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764841.277522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6618 00000100:00100000:1.0:1775764841.284231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764841.284500:0:8408:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146176 00000100:00100000:3.0:1775764841.284511:0:8408:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146176 00002000:00100000:3.0:1775764841.284573:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x57:0x0] (0->4095) req@ffff96c1c2eb6a00 x1862023076146176/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:322/0 lens 488/0 e 0 to 0 dl 1775764852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764841.284586:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2eb6a00 with x1862023076146176 ext(0->4095) 00002000:00010000:3.0:1775764841.284592:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c2eb6a00 00000100:00100000:3.0:1775764841.284625:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 437 00000100:00100000:3.0:1775764841.284635:0:8408:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076146176:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1775764841.284863:0:8408:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076146176:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 228us (641us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1775764841.284872:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 437 00002000:00100000:3.0:1775764841.284878:0:8408:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x57:0x0] (0->4095) req@ffff96c1c2eb6a00 x1862023076146176/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:322/0 lens 488/4536 e 0 to 0 dl 1775764852 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764841.284885:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2eb6a00 with x1862023076146176 ext(0->4095) 00002000:00010000:3.0:1775764841.284888:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c2eb6a00 00000100:00100000:3.0:1775764841.290282:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764841.290468:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146304 00000100:00100000:1.0:1775764841.290479:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146304 00000100:00100000:1.0:1775764841.290548:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6619 00000100:00100000:1.0:1775764841.290557:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+54:49555:x1862023076146304:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1775764841.290580:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764841.290602:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed523fb4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55a2 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.290635:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.290668:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.290682:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.290820:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed523fb4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 56 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.290841:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 55 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.290849:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:1.0:1775764841.290851:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1775764841.290855:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403fa00, rc 0) 00000100:00100000:1.0:1775764841.290908:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076146304:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 353us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764841.290915:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6619 00000100:00100000:1.0:1775764841.311733:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764841.313193:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146432 00000100:00100000:2.0:1775764841.313224:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146432 00000100:00100000:2.0:1775764841.313308:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6620 00000100:00100000:2.0:1775764841.313318:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076146432:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764841.313366:0:10088:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa0:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1775764841.313494:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076146432:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 178us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764841.313503:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6620 00000100:00100000:1.0:1775764841.320576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764841.321290:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146560 00000100:00100000:3.0:1775764841.321303:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146560 00000100:00100000:3.0:1775764841.321377:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1748 00000100:00100000:3.0:1775764841.321387:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076146560:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764841.321438:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321480:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764841.321483:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764841.321489:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321503:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321544:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321553:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321562:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321569:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764841.321574:0:15167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321592:0:15167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321607:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.321626:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed523fc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764841.321714:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076146560:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 327us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764841.321723:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1748 00010000:00010000:1.0:1775764841.330729:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764841.344090:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764841.346905:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146816 00000100:00100000:1.0:1775764841.346924:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146816 00000100:00100000:1.0:1775764841.347054:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6621 00000100:00100000:1.0:1775764841.347065:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076146816:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1775764841.348337:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.348377:0:10681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 55 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.348387:0:10681:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 4/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.348429:0:10681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 55 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.348443:0:10681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 55 pid: 14288 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764841.348458:0:10681:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099829376:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764841.348566:0:10681:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c7149780 going to sleep for 11 seconds 00000100:00100000:1.0:1775764841.353571:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764841.353662:0:10681:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10681:1862023099829376:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764841.353691:0:10681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764841.353754:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076146944 00000100:00100000:3.0:1775764841.353761:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076146944 00010000:00010000:3.0:1775764841.353822:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 56 pid: 14288 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764841.353854:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1428 00000100:00100000:3.0:1775764841.353863:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+56:2410:x1862023076146944:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764841.353878:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764841.353884:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 56 pid: 14288 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.353896:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 56 pid: 14288 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.353918:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fa00/0x6e98bd47ed523fbb lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a2 expref: 56 pid: 14288 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.353934:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:3.0:1775764841.353950:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.353960:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.353968:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764841.354859:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764841.354928:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:2410:x1862023076146944:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 1063us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764841.354939:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1428 00010000:00010000:0.0:1775764841.366137:0:10681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764841.366153:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366393:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366402:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366409:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366415:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764841.366419:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366426:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366456:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:1.0:1775764841.366459:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1775764841.366464:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764841.366469:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed523fc9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764841.366628:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076146816:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 19561us (22543us total) trans 4294970707 rc 0/0 00000100:00100000:1.0:1775764841.366639:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6621 00000040:00080000:0.0:1775764841.367207:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764841.367213:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764841.367718:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1775764841.367728:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764841.370093:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764841.370180:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076147200 00000100:00100000:3.0:1775764841.370191:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076147200 00000100:00100000:3.0:1775764841.370257:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1384 00000100:00100000:3.0:1775764841.370268:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:49555:x1862023076147200:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764841.370579:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+56:49555:x1862023076147200:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 312us (495us total) trans 4294970708 rc 0/0 00000100:00100000:3.0:1775764841.370588:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1384 00000040:00080000:2.0:1775764841.963301:0:31359:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764841.963312:0:31359:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764841.963353:0:31359:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 155 count 5 00000040:00080000:2.0:1775764841.963361:0:31359:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764842.039585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764842.039667:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076147328 00000100:00100000:0.0:1775764842.039678:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076147328 00000100:00100000:0.0:1775764842.039759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6622 00000100:00100000:0.0:1775764842.039807:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49556:x1862023076147328:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:0.0:1775764842.039832:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764842.039859:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523fd0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55a9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.039955:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.039971:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.039983:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040001:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040008:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040014:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040054:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040062:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040068:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040075:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040081:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6de00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764842.040091:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040099:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040114:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764842.040118:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764842.040122:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed523fd7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040139:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040145:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040151:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040156:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764842.040159:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040165:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040171:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c2c6356300) 00010000:00010000:0.0:1775764842.040174:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764842.040182:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040188:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed523fde lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040220:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523fd0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a9 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040243:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764842.040245:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764842.040250:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed523fd0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55a9 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.040260:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d200, rc 0) 00000100:00100000:0.0:1775764842.040326:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49556:x1862023076147328:12345-192.168.202.58@tcp:101:bash.0 Request processed in 556us (752us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764842.040334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6622 00000100:00080000:1.0:1775764842.041058:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764842.064941:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.068623:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076147456 00000100:00100000:3.0:1775764842.068638:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076147456 00000100:00100000:3.0:1775764842.068705:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6623 00000100:00100000:3.0:1775764842.068716:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:49557:x1862023076147456:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764842.068744:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.068765:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523fe5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068879:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068894:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068906:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068921:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068927:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068932:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068975:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068982:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068988:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.068995:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069002:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.069012:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069020:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069035:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.069038:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.069043:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed523fec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069060:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069066:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069071:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069075:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.069077:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069082:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069088:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.069090:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.069099:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069104:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed523ff3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069142:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523fe5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55b0 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.069154:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.069157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed523fe5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55b0 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.069165:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764842.069248:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+56:49557:x1862023076147456:12345-192.168.202.58@tcp:101:rm.0 Request processed in 534us (4317us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764842.069255:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6623 00000100:00100000:3.0:1775764842.076211:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764842.076337:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076147584 00000100:00100000:2.0:1775764842.076348:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076147584 00000100:00100000:2.0:1775764842.076405:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6624 00000100:00100000:2.0:1775764842.076413:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+56:49557:x1862023076147584:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764842.076434:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764842.076453:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523ffa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55b7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076523:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076538:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076551:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076582:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076590:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076597:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076635:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076641:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076647:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076653:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076658:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764842.076662:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076669:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076680:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764842.076683:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764842.076688:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076700:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524001 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076712:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076718:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076723:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076728:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764842.076730:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076735:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076742:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c7207800) 00010000:00010000:2.0:1775764842.076745:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764842.076747:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076753:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed524008 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076822:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523ffa lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55b7 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076844:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764842.076846:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764842.076850:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed523ffa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55b7 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.076859:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3800, rc 0) 00000100:00100000:2.0:1775764842.076919:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+56:49557:x1862023076147584:12345-192.168.202.58@tcp:101:rm.0 Request processed in 507us (719us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764842.076927:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6624 00000100:00100000:2.0:1775764842.092571:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.092652:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076147712 00000100:00100000:3.0:1775764842.092664:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076147712 00000100:00100000:3.0:1775764842.092727:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6625 00000100:00100000:3.0:1775764842.092738:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+56:49558:x1862023076147712:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764842.092762:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.092821:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52400f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55be expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.092897:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.092927:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.092939:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.092955:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.092961:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.092967:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093004:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093012:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093017:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093022:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.093275:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093286:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093299:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.093308:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.093315:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093321:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524016 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093335:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093339:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093345:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093350:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.093353:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093359:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093367:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.093369:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.093371:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093377:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52401d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093421:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52400f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55be expref: 57 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093439:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.093441:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.093445:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed52400f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55be expref: 57 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.093454:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764842.093564:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+56:49558:x1862023076147712:12345-192.168.202.58@tcp:101:cp.0 Request processed in 827us (1003us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764842.093573:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6625 00000100:00100000:2.0:1775764842.104306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.104382:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076147840 00000100:00100000:3.0:1775764842.104395:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076147840 00000100:00100000:3.0:1775764842.104463:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6626 00000100:00100000:3.0:1775764842.104474:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:49558:x1862023076147840:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764842.104506:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.104536:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed524024 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55c5 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104613:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104630:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104643:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104660:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104681:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104689:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104726:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104734:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104740:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104746:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.104751:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.104760:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105169:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.105173:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.105179:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105186:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52402b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105201:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105215:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105220:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105225:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.105240:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105246:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105254:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a04d00) 00010000:00010000:3.0:1775764842.105256:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.105259:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105264:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524032 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105299:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed524024 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55c5 expref: 57 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105308:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.105310:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.105313:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed524024 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55c5 expref: 57 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.105335:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764842.105402:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+56:49558:x1862023076147840:12345-192.168.202.58@tcp:101:cp.0 Request processed in 929us (1105us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764842.105410:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6626 00000100:00100000:2.0:1775764842.121153:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.121519:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148096 00000100:00100000:3.0:1775764842.121542:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148096 00000100:00100000:3.0:1775764842.121605:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6627 00000100:00100000:3.0:1775764842.121618:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+56:49558:x1862023076148096:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764842.121640:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.121664:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524039 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55cc expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.122394:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.122414:0:10088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.122424:0:10088:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.122467:0:10088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.122496:0:10088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 43 pid: 6523 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.122688:0:10088:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099829504:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764842.122819:0:10088:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c8551e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775764842.132280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764842.132476:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148224 00000100:00100000:1.0:1775764842.132499:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148224 00010000:00010000:1.0:1775764842.132549:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 44 pid: 6523 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764842.132594:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1429 00000100:00100000:1.0:1775764842.132604:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2410:x1862023076148224:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764842.132620:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764842.132627:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 44 pid: 6523 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.132641:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 44 pid: 6523 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.132682:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764842.132688:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.132699:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.132708:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.132729:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764842.132822:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2410:x1862023076148224:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 219us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764842.132830:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1429 00010000:00010000:3.0:1775764842.133258:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa5800/0x6e98bd47ed523f83 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5586 expref: 43 pid: 6523 timeout: 1449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.133278:0:10088:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10088:1862023099829504:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764842.133298:0:10088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133308:0:10088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133314:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133337:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133348:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133357:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1775764842.133722:0:10088:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x58:0x0], index 1: 0 00010000:00010000:3.0:1775764842.133920:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133939:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133947:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133981:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133988:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.133994:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134000:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.134005:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134012:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134022:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.134025:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.134029:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134035:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed524040 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764842.134044:0:10088:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b6b9423d reply state 00000000c9c5cbb9 transno 4294970709 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134059:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134065:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a04d00) 00010000:00010000:3.0:1775764842.134067:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764842.134070:0:10088:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1775764842.134104:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524039 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 59 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134118:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 58 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.134125:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.134128:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764842.134130:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1800, rc 0) 00000100:00100000:3.0:1775764842.134186:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+59:49558:x1862023076148096:12345-192.168.202.58@tcp:101:cp.0 Request processed in 12571us (13043us total) trans 4294970709 rc 0/0 00000100:00100000:3.0:1775764842.134193:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6627 00000100:00100000:0.0:1775764842.143128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764842.143198:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148352 00000100:00100000:2.0:1775764842.143208:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148352 00000100:00100000:2.0:1775764842.143614:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1749 00000100:00100000:2.0:1775764842.143624:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076148352:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764842.143642:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764842.143661:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55d3 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764842.143688:0:24969:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1775764842.143706:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764842.143708:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764842.143717:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 11 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.143747:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 11 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.143762:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3e00, rc 0) 00000100:00100000:2.0:1775764842.143856:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+11:2410:x1862023076148352:12345-192.168.202.58@tcp:101:cp.0 Request processed in 234us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764842.143864:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1749 00000100:00080000:0.0:1775764842.147352:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764842.155205:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.155280:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148480 00000100:00100000:3.0:1775764842.155292:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148480 00000100:00100000:3.0:1775764842.155342:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1750 00000100:00100000:3.0:1775764842.155351:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+11:49558:x1862023076148480:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764842.155370:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.155389:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55da expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.155420:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.155436:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764842.155438:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764842.155443:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 12 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.155473:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.155595:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.155611:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099829632:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764842.155691:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c8551cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764842.158840:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.159043:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099829632:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764842.159094:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 12 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.159119:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba0400, rc 0) 00000100:00100000:3.0:1775764842.159175:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+12:49558:x1862023076148480:12345-192.168.202.58@tcp:101:cp.0 Request processed in 3824us (3977us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.159184:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1750 00000100:00100000:0.0:1775764842.160450:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148608 00000100:00100000:0.0:1775764842.160465:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148608 00010000:00010000:0.0:1775764842.160683:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764842.160737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1430 00000100:00100000:0.0:1775764842.160748:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+12:2409:x1862023076148608:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764842.160831:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764842.160856:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.160871:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.160898:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9e578b/0x6e98bd47ed52405c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55d3 expref: 12 pid: 24969 timeout: 1449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.160914:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764842.160917:0:6507:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764842.160924:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 11 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.160935:0:6507:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 11 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.160990:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 11 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764842.161008:0:6507:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7447480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1862023099829760:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764842.161092:0:6507:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b48780 going to sleep for 11 seconds 00000100:00100000:2.0:1775764842.165449:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.165664:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148864 00000100:00100000:3.0:1775764842.165676:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148864 00000100:00100000:3.0:1775764842.165740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1385 00000100:00100000:3.0:1775764842.165765:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df702850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:49558:x1862023076148864:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:3.0:1775764842.166113:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df702850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+60:49558:x1862023076148864:12345-192.168.202.58@tcp:35:cp.0 Request processed in 348us (672us total) trans 4294970710 rc 0/0 00000100:00100000:3.0:1775764842.166121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1385 00000100:00100000:0.0:1775764842.166580:0:6507:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7447480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1862023099829760:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764842.166600:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764842.166630:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb64567-481f-43c2-999a-8c9c071338ae+11:2409:x1862023076148608:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 5886us (7801us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764842.166638:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1430 00000100:00100000:0.0:1775764842.220282:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.220739:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076148992 00000100:00100000:3.0:1775764842.220751:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076148992 00000100:00100000:3.0:1775764842.220846:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6628 00000100:00100000:3.0:1775764842.220856:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:49561:x1862023076148992:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764842.220875:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.220898:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed52406a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55e1 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.220969:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.220984:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.220996:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221008:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221014:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221020:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221301:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221309:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221316:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764842.221354:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa1:0x0]: returning size 1516 00000004:00200000:3.0:1775764842.221359:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764842.221379:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221390:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221398:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221404:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221410:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221416:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221422:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.221426:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221439:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221451:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764842.221454:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.221459:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221464:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524071 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221477:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221483:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221699:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221704:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d8a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.221707:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221713:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221722:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a04d00) 00010000:00010000:3.0:1775764842.221724:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764842.221727:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.221740:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524078 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.222186:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed52406a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55e1 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.222205:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55e1 expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.222213:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.222215:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764842.222218:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764842.222310:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49561:x1862023076148992:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 1454us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.222319:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6628 00000100:00100000:3.0:1775764842.226060:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764842.226270:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076149120 00000100:00100000:0.0:1775764842.226281:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076149120 00000100:00100000:0.0:1775764842.226356:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1751 00000100:00100000:0.0:1775764842.226366:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076149120:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764842.226383:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764842.226401:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001528e540/0x6e98bd47ed524086 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55e8 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764842.226461:0:15167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099829888:192.168.202.58@tcp:106: 00000100:00100000:0.0:1775764842.226556:0:15167:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b48780 going to sleep for 11 seconds 00000100:00080000:1.0:1775764842.226625:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1775764842.245477:0:15167:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1775764842.245488:0:15167:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb mtime: 0 -> 1775764841 00002000:00010000:0.0:1775764842.245491:0:15167:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb atime: 0 -> 1775764841 00002000:00010000:0.0:1775764842.245494:0:15167:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb ctime: 0 -> 1775764841 00002000:00010000:0.0:1775764842.245496:0:15167:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1775764842.245535:0:15167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15167:1862023099829888:192.168.202.58@tcp:106: 00010000:00010000:0.0:1775764842.245581:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001528e540/0x6e98bd47ed524086 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55e8 expref: 10 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.245608:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001528e540/0x6e98bd47ed524086 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55e8 expref: 10 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.245641:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6de00, rc 0) 00000100:00100000:0.0:1775764842.245722:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076149120:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 19356us (19667us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764842.245731:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1751 00000100:00100000:0.0:1775764842.268184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764842.268218:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076149248 00000100:00100000:0.0:1775764842.268241:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076149248 00000100:00100000:0.0:1775764842.268297:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6629 00000100:00100000:0.0:1775764842.268307:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:49561:x1862023076149248:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764842.268327:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764842.268346:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52408d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55ef expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.268422:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed524094 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.268439:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed524094 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.268452:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed524094 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764842.268499:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x17:0x0]: returning size 4096 00000004:00200000:0.0:1775764842.268503:0:10681:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1775764842.268537:0:10681:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed524094 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.268563:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6de00/0x6e98bd47ed52408d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55ef expref: 46 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.268596:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed524094 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55ef expref: 45 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.268606:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:0.0:1775764842.268609:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1775764842.268612:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d800, rc 0) 00000100:00100000:0.0:1775764842.268677:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49561:x1862023076149248:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 371us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764842.268685:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6629 00000100:00100000:3.0:1775764842.272671:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764842.272758:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076149376 00000100:00100000:2.0:1775764842.272798:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076149376 00000100:00100000:2.0:1775764842.272862:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1752 00000100:00100000:2.0:1775764842.272872:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076149376:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764842.272894:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764842.272913:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed52409b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55f6 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764842.272982:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c71aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099830016:192.168.202.58@tcp:106: 00000100:00100000:2.0:1775764842.273069:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20f00 going to sleep for 11 seconds 00000100:00100000:2.0:1775764842.285846:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c71aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099830016:192.168.202.58@tcp:106: 00010000:00010000:2.0:1775764842.285887:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed52409b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55f6 expref: 10 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.285942:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008220a350/0x6e98bd47ed52409b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55f6 expref: 10 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.285955:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3800, rc 0) 00000100:00100000:2.0:1775764842.286008:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076149376:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 13138us (13351us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764842.286017:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1752 00000100:00100000:2.0:1775764842.290704:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764842.290726:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099830144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764842.290828:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764842.290872:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099830144 00000100:00100000:2.0:1775764842.290879:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099830144 00000100:00100000:2.0:1775764842.290929:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1775764842.290938:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099830144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1775764842.290981:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:2.0:1775764842.291049:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099830144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764842.291056:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1775764842.291077:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099830144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764842.291946:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764842.292025:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076149632 00000100:00100000:2.0:1775764842.292041:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076149632 00000100:00100000:2.0:1775764842.292089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6630 00000100:00100000:2.0:1775764842.292097:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49561:x1862023076149632:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:2.0:1775764842.292270:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].155, 136 off29064 00000100:00100000:2.0:1775764842.292356:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49561:x1862023076149632:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 259us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764842.292380:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6630 00010000:00010000:3.0:1775764842.354207:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764842.435857:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764842.435865:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764842.435893:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 156 count 6 00000040:00080000:2.0:1775764842.435900:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764842.436189:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e49500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099830272:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764842.436353:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ffa20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1775764842.443956:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e49500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099830272:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764842.444882:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.445245:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076149760 00000100:00100000:3.0:1775764842.445255:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076149760 00000100:00100000:3.0:1775764842.445306:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6631 00000100:00100000:3.0:1775764842.445314:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:49571:x1862023076149760:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764842.445348:0:10088:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa1:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764842.445458:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:49571:x1862023076149760:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 144us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.446033:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6631 00000100:00100000:0.0:1775764842.449251:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.449358:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150016 00000100:00100000:3.0:1775764842.449368:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150016 00000100:00100000:3.0:1775764842.449425:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6632 00000100:00100000:3.0:1775764842.449435:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+60:49571:x1862023076150016:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764842.449457:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.449477:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd55fd expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.452411:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.452427:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.452439:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764842.452451:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa1:0x0]: returning size 1516 00010000:00010000:3.0:1775764842.452572:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55fd expref: 63 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.452589:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55fd expref: 62 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.452599:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.452601:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764842.452605:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764842.452680:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076150016:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 3246us (3438us total) trans 4294970711 rc 0/0 00000100:00100000:3.0:1775764842.452690:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6632 00000100:00100000:1.0:1775764842.473814:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764842.473876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764842.473969:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150144 00000100:00100000:0.0:1775764842.473981:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150144 00000100:00100000:0.0:1775764842.474042:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1753 00000100:00100000:0.0:1775764842.474051:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+11:2408:x1862023076150144:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1775764842.474102:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.474123:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 11 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.474132:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1775764842.474135:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1775764842.474138:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.474195:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 11 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.474210:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 11 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764842.474239:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff870380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099830400:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764842.474324:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b48780 going to sleep for 11 seconds 00000100:00100000:3.0:1775764842.475420:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150272 00000100:00100000:3.0:1775764842.475430:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150272 00000100:00100000:3.0:1775764842.475569:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 760 00000100:00100000:3.0:1775764842.475579:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+62:2411:x1862023076150272:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764842.475593:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764842.475617:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55fd expref: 62 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.475634:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.475639:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764842.475684:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+61:2411:x1862023076150272:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 107us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.475691:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 760 00000100:00100000:0.0:1775764842.487995:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff870380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1862023099830400:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764842.488029:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764842.492143:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764842.493096:0:16794:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150400 00000100:00100000:0.0:1775764842.493107:0:16794:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150400 00002000:00100000:0.0:1775764842.493158:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x58:0x0] (0->1515) req@ffff96c1c2e48e00 x1862023076150400/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:323/0 lens 2008/0 e 0 to 0 dl 1775764853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764842.493169:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2e48e00 with x1862023076150400 ext(0->1515) 00010000:00010000:0.0:1775764842.493178:0:16794:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 12 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.493195:0:16794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 12 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764842.493203:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c1c2e48e00 00000100:00100000:0.0:1775764842.493253:0:16794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 36 00000100:00100000:0.0:1775764842.493262:0:16794:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2bb64567-481f-43c2-999a-8c9c071338ae+12:2410:x1862023076150400:12345-192.168.202.58@tcp:4:cp.0 00000100:00100000:0.0:1775764842.496139:0:16794:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2bb64567-481f-43c2-999a-8c9c071338ae+14:2410:x1862023076150400:12345-192.168.202.58@tcp:4:cp.0 Request processed in 2866us (3996us total) trans 4294967730 rc 0/0 00000100:00100000:0.0:1775764842.496153:0:16794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 36 00002000:00100000:0.0:1775764842.496167:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x58:0x0] (0->1515) req@ffff96c1c2e48e00 x1862023076150400/t4294967730(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:323/0 lens 2008/448 e 0 to 0 dl 1775764853 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764842.496177:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2e48e00 with x1862023076150400 ext(0->1515) 00010000:00010000:0.0:1775764842.496189:0:16794:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 14 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.496212:0:16794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 14 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764842.496219:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c1c2e48e00 00000100:00100000:0.0:1775764842.507109:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.507963:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150528 00000100:00100000:3.0:1775764842.507975:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150528 00010000:00010000:3.0:1775764842.508016:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 14 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.508062:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1431 00000100:00100000:3.0:1775764842.508072:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+14:2410:x1862023076150528:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764842.508087:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1775764842.508105:0:25200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x58:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1775764842.508113:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 14 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.508140:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 14 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.508165:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928f7d10/0x6e98bd47ed524063 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55da expref: 14 pid: 8641 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.508180:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764842.508182:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764842.508187:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.508198:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.508241:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764842.508294:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+13:2410:x1862023076150528:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 223us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.508302:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1431 00010000:00010000:2.0:1775764842.509920:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.509946:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.509974:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.509982:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.509990:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.509997:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764842.510001:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.510021:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.510040:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764842.510047:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbd59d1f/0x6e98bd47ed5240b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764842.510128:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+12:2408:x1862023076150144:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 36074us (36320us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764842.510137:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1753 00000100:00100000:0.0:1775764842.515861:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.515985:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150784 00000100:00100000:3.0:1775764842.515999:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150784 00000100:00100000:3.0:1775764842.516057:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6633 00000100:00100000:3.0:1775764842.516068:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+61:49571:x1862023076150784:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764842.516181:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+61:49571:x1862023076150784:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.516188:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6633 00000100:00100000:3.0:1775764842.529569:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764842.530349:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076150912 00000100:00100000:0.0:1775764842.530361:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076150912 00000100:00100000:0.0:1775764842.530425:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1754 00000100:00100000:0.0:1775764842.530435:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+12:2408:x1862023076150912:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764842.530454:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764842.530476:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001528e540/0x6e98bd47ed5240be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5604 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764842.530511:0:8402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x58:0x0] initial LVB size: 1516, mtime: 0x69d80569, atime: 0x0, ctime: 0x69d80569, blocks: 0x8 00010000:00010000:0.0:1775764842.530544:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764842.530546:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764842.530555:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001528e540/0x6e98bd47ed5240be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5604 expref: 13 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.530572:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001528e540/0x6e98bd47ed5240be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5604 expref: 13 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764842.530585:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6de00, rc 0) 00000100:00100000:0.0:1775764842.530644:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+13:2408:x1862023076150912:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 210us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764842.530651:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1754 00000100:00100000:0.0:1775764842.537837:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.538144:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076151168 00000100:00100000:3.0:1775764842.538155:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076151168 00000100:00100000:3.0:1775764842.538220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6634 00000100:00100000:3.0:1775764842.538242:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+61:49571:x1862023076151168:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764842.538356:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+61:49571:x1862023076151168:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.538381:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6634 00000100:00100000:2.0:1775764842.554055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.554363:0:8410:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076151296 00000100:00100000:3.0:1775764842.554374:0:8410:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076151296 00002000:00100000:3.0:1775764842.554422:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x58:0x0] (0->4095) req@ffff96c1c2e4a680 x1862023076151296/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:323/0 lens 488/0 e 0 to 0 dl 1775764853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764842.554433:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2e4a680 with x1862023076151296 ext(0->4095) 00002000:00010000:3.0:1775764842.554439:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c2e4a680 00000100:00100000:3.0:1775764842.554468:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 438 00000100:00100000:3.0:1775764842.554485:0:8410:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+13:2409:x1862023076151296:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1775764842.554670:0:8410:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+13:2409:x1862023076151296:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 193us (625us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1775764842.554679:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 438 00002000:00100000:3.0:1775764842.554684:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x58:0x0] (0->4095) req@ffff96c1c2e4a680 x1862023076151296/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:323/0 lens 488/4536 e 0 to 0 dl 1775764853 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764842.554692:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c2e4a680 with x1862023076151296 ext(0->4095) 00002000:00010000:3.0:1775764842.554695:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96c1c2e4a680 00000100:00100000:1.0:1775764842.568566:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.568706:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076151424 00000100:00100000:3.0:1775764842.568718:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076151424 00000100:00100000:3.0:1775764842.568828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6635 00000100:00100000:3.0:1775764842.568840:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+61:49571:x1862023076151424:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764842.568863:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764842.568888:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240c5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd560b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.568929:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.568959:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.568973:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.569093:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed5240c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.569110:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.569118:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.569121:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764842.569125:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764842.569182:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076151424:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 345us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764842.569189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6635 00000100:00100000:3.0:1775764842.578193:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764842.578339:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076151552 00000100:00100000:1.0:1775764842.578350:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076151552 00000100:00100000:1.0:1775764842.578417:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6636 00000100:00100000:1.0:1775764842.578428:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076151552:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764842.578462:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa1:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764842.578601:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076151552:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 175us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764842.578609:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6636 00000100:00100000:3.0:1775764842.582581:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764842.582671:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076151680 00000100:00100000:1.0:1775764842.582681:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076151680 00000100:00100000:1.0:1775764842.582741:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1755 00000100:00100000:1.0:1775764842.582750:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+13:2411:x1862023076151680:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1775764842.582835:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582853:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764842.582856:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764842.582860:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582876:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582901:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582909:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582918:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582925:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403ea00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764842.582930:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582960:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582977:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.582985:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed5240d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764842.583060:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+13:2411:x1862023076151680:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 311us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764842.583069:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1755 00000100:00100000:0.0:1775764842.590876:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.590958:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076151936 00000100:00100000:3.0:1775764842.590968:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076151936 00000100:00100000:3.0:1775764842.591024:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6637 00000100:00100000:3.0:1775764842.591033:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076151936:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764842.591108:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.591126:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.591136:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 4/0,1 mode: --/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.591172:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.591186:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 62 pid: 6522 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.591201:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f66d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099830528:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764842.591305:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c8551a80 going to sleep for 11 seconds 00000100:00100000:0.0:1775764842.598483:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764842.598622:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152064 00000100:00100000:1.0:1775764842.598633:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152064 00010000:00010000:1.0:1775764842.598671:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 63 pid: 6522 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764842.598713:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1432 00000100:00100000:1.0:1775764842.598722:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+63:2410:x1862023076152064:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764842.598737:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764842.598744:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 63 pid: 6522 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.598765:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 63 pid: 6522 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.598833:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:1.0:1775764842.598838:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.598846:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.598853:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764842.598872:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764842.598920:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+63:2410:x1862023076152064:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 199us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764842.598927:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1432 00010000:00010000:3.0:1775764842.604329:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9e00/0x6e98bd47ed5240cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd560b expref: 62 pid: 6522 timeout: 1450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.604354:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f66d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099830528:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764842.604380:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604411:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604416:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604587:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604596:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604604:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604610:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764842.604614:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604621:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604638:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764842.604641:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1775764842.604645:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 2/0,0 mode: --/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764842.604650:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed5240da lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764842.604817:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076151936:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 13782us (13947us total) trans 4294970712 rc 0/0 00000100:00100000:3.0:1775764842.604834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6637 00000040:00080000:1.0:1775764842.605350:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764842.605356:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764842.605865:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:1.0:1775764842.605874:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764842.608288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764842.608356:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152320 00000100:00100000:3.0:1775764842.608366:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152320 00000100:00100000:3.0:1775764842.608431:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1386 00000100:00100000:3.0:1775764842.608442:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+62:49571:x1862023076152320:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1775764842.608766:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+63:49571:x1862023076152320:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 325us (485us total) trans 4294970713 rc 0/0 00000100:00100000:3.0:1775764842.609089:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1386 00000100:00100000:1.0:1775764843.314563:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764843.314588:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099830656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764843.314663:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764843.314728:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099830656 00000100:00100000:1.0:1775764843.314735:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099830656 00000100:00100000:1.0:1775764843.314819:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1775764843.314830:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099830656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764843.314857:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42406080 pending 28672 free 3916951552 avail 3685429248 00000100:00100000:1.0:1775764843.314911:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099830656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764843.314918:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00080000:1.0:1775764843.314953:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764843.314989:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099830656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764843.318149:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1775764843.318174:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099830784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764843.318256:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764843.318644:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099830784 00000100:00100000:0.0:1775764843.318652:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099830784 00000100:00100000:0.0:1775764843.318724:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1775764843.318733:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099830784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764843.318757:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42406080 pending 28672 free 3916951552 avail 3685429248 00000100:00100000:0.0:1775764843.318834:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099830784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764843.318842:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:1.0:1775764843.318967:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764843.319687:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099830784:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1775764843.341995:0:31411:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764843.342005:0:31411:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764843.342045:0:31411:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 156 count 6 00000040:00080000:1.0:1775764843.342051:0:31411:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1775764843.386957:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764844.339102:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764844.339128:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099830912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764844.339206:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764844.339290:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099830912 00000100:00100000:1.0:1775764844.339297:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099830912 00000100:00100000:1.0:1775764844.339346:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1775764844.339353:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099830912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764844.339388:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1775764844.339431:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099830912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764844.339437:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1775764844.339476:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099830912:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1775764844.402562:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764844.678565:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678603:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678629:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678651:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678668:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678685:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678702:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678719:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.678738:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764844.679672:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152448 00000100:00100000:3.0:1775764844.679684:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152448 00000100:00100000:3.0:1775764844.679739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 977 00000100:00100000:3.0:1775764844.679748:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076152448:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683166:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076152448:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 3406us (4598us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.683180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 977 00000100:00100000:3.0:1775764844.683249:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152704 00000100:00100000:3.0:1775764844.683257:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152704 00000100:00100000:3.0:1775764844.683305:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153216 00000100:00100000:3.0:1775764844.683309:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153216 00000100:00100000:3.0:1775764844.683329:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152576 00000100:00100000:3.0:1775764844.683333:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152576 00000100:00100000:3.0:1775764844.683351:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153088 00000100:00100000:3.0:1775764844.683354:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153088 00000100:00100000:3.0:1775764844.683370:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1964 00000100:00100000:3.0:1775764844.683378:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076152704:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683423:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076152704:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 46us (4819us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.683430:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1964 00000100:00100000:3.0:1775764844.683442:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1965 00000100:00100000:3.0:1775764844.683448:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076153216:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683473:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076153216:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.683479:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1965 00000100:00100000:3.0:1775764844.683490:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1966 00000100:00100000:3.0:1775764844.683496:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+63:2410:x1862023076152576:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683522:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+63:2410:x1862023076152576:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.683539:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1966 00000100:00100000:3.0:1775764844.683552:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1967 00000100:00100000:3.0:1775764844.683558:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2410:x1862023076153088:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683583:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2410:x1862023076153088:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (4863us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.683590:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1967 00000100:00100000:3.0:1775764844.683609:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152960 00000100:00100000:3.0:1775764844.683613:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152960 00000100:00100000:3.0:1775764844.683639:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153472 00000100:00100000:3.0:1775764844.683642:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153472 00000100:00100000:3.0:1775764844.683659:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076152832 00000100:00100000:3.0:1775764844.683662:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076152832 00000100:00100000:3.0:1775764844.683674:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153344 00000100:00100000:3.0:1775764844.683676:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153344 00000100:00100000:3.0:1775764844.683690:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1432 00000100:00100000:3.0:1775764844.683695:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+13:2410:x1862023076152960:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683722:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+13:2410:x1862023076152960:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (5092us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.683728:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1432 00000100:00100000:3.0:1775764844.683739:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1433 00000100:00100000:3.0:1775764844.683745:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076153472:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.683793:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076153472:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.688018:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1433 00000100:00100000:3.0:1775764844.688063:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1434 00000100:00100000:3.0:1775764844.688090:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076152832:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.688172:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076152832:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 89us (9469us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.688179:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1434 00000100:00100000:3.0:1775764844.688193:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1435 00000100:00100000:3.0:1775764844.688201:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076153344:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764844.691458:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076153344:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 3250us (12710us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764844.691471:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1435 00000100:00080000:2.0:1775764844.697447:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1775764844.697458:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1775764844.697461:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764844.697464:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764844.850633:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099831040:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.850711:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764844.850811:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775764844.850818:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099831168:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.850845:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764844.850880:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831168 00000100:00100000:2.0:1775764844.850888:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831168 00000100:00100000:2.0:1775764844.851091:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1775764844.851115:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099831168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.851170:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099831168:12345-0@lo:400:kworker.0 Request processed in 56us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.851177:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1775764844.851235:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099831168:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.851325:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831040 00000100:00100000:0.0:1775764844.851330:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831040 00000100:00100000:0.0:1775764844.851371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1775764844.851379:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099831040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.851423:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099831040:12345-0@lo:400:kworker.0 Request processed in 45us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764844.851430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1775764844.851464:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099831040:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.851994:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099831296:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852029:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764844.852050:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099831808:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852071:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764844.852087:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099832320:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852105:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764844.852125:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1775764844.852130:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099831424:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852152:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764844.852168:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099831936:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852187:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764844.852200:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099832448:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852233:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764844.852261:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831296 00000100:00100000:0.0:1775764844.852266:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831296 00000100:00100000:0.0:1775764844.852300:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1775764844.852307:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099831296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.852346:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099831296:12345-0@lo:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764844.852353:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1775764844.852383:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831808 00000100:00100000:0.0:1775764844.852388:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831808 00000100:00100000:0.0:1775764844.852410:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832320 00000100:00100000:0.0:1775764844.852412:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832320 00000100:00100000:0.0:1775764844.852440:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831936 00000100:00100000:0.0:1775764844.852442:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831936 00000100:00100000:0.0:1775764844.852453:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832448 00000100:00100000:0.0:1775764844.852455:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832448 00000100:00100000:0.0:1775764844.852468:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1775764844.852473:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099831808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.852618:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099831552:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.852645:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764844.852663:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099832064:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.852681:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764844.852698:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1775764844.852704:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099831680:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.852722:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764844.852735:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099832192:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.852752:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764844.852882:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831424 00000100:00100000:2.0:1775764844.852887:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831424 00000100:00100000:2.0:1775764844.852914:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831552 00000100:00100000:2.0:1775764844.852989:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831552 00000100:00100000:2.0:1775764844.853014:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832064 00000100:00100000:2.0:1775764844.853019:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832064 00000100:00100000:2.0:1775764844.853030:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099831680 00000100:00100000:2.0:1775764844.853032:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099831680 00000100:00100000:2.0:1775764844.853042:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832192 00000100:00100000:2.0:1775764844.853044:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832192 00000100:00100000:2.0:1775764844.853056:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1775764844.853062:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099831424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853095:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099831424:12345-0@lo:400:kworker.0 Request processed in 33us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.853109:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1775764844.853123:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1775764844.853128:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099831552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853158:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099831552:12345-0@lo:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.853163:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1775764844.853173:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1775764844.853178:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099832064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853201:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099832064:12345-0@lo:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.853218:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1775764844.853228:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1775764844.853234:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099831680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853258:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099831680:12345-0@lo:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.853265:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1775764844.853274:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1775764844.853280:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099832192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853301:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099832192:12345-0@lo:400:kworker.0 Request processed in 21us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.853306:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1775764844.853351:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099831680:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853359:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099832192:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853379:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099831552:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853386:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099832064:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853441:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1775764844.853448:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099832320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.853477:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099832320:12345-0@lo:400:kworker.0 Request processed in 30us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.853483:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1775764844.853496:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1775764844.853616:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099831808:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764844.853624:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1775764844.853636:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1775764844.853643:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099832448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.853671:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099832448:12345-0@lo:400:kworker.0 Request processed in 30us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764844.853677:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00080000:0.0:1775764844.853695:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764844.853700:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1775764844.853703:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764844.853723:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099831424:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.853733:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099832448:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.853744:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099831296:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.853753:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099831808:0@lo:400:kworker.0 00000100:00100000:0.0:1775764844.853761:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099832320:0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.854298:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099831936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764844.854337:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099831936:12345-0@lo:400:kworker.0 Request processed in 835us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764844.854343:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1775764844.861361:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099831936:0@lo:400:kworker.0 00000100:00100000:1.0:1775764845.362013:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1775764845.362038:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099832576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764845.362114:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764845.362175:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832576 00000100:00100000:1.0:1775764845.362183:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832576 00000100:00100000:1.0:1775764845.362239:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:1.0:1775764845.362247:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099832576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764845.362278:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510218432 pending 57344 free 3886530560 avail 3655008256 00000100:00100000:1.0:1775764845.362327:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099832576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764845.362334:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:1.0:1775764845.362375:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099832576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764845.363021:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775764845.363033:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099832704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764845.363067:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764845.363137:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832704 00000100:00100000:2.0:1775764845.363142:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832704 00000100:00100000:2.0:1775764845.363179:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:2.0:1775764845.363187:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099832704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764845.363210:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510218432 pending 57344 free 3886530560 avail 3655008256 00000100:00100000:2.0:1775764845.363246:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099832704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764845.363253:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1775764845.363317:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099832704:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1775764845.429495:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764845.681977:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764845.681989:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764845.682089:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 156 count 4 00000040:00080000:0.0:1775764845.682099:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1775764846.407559:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967730 is committed 00010000:00010000:3.0:1775764846.460667:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1775764846.899374:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967729 is committed 00000001:00080000:2.0:1775764846.904278:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970713 is committed 00010000:00010000:3.0:1775764846.904359:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764846.904372:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764846.904380:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764846.904386:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764846.904390:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764846.904398:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764846.904417:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a04d00) 00010000:00010000:3.0:1775764846.904434:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764846.904441:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764846.904446:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524047 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764847.410160:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099832832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1775764847.411565:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764847.411717:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832832 00000100:00100000:3.0:1775764847.411727:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832832 00000100:00100000:3.0:1775764847.411809:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1775764847.411820:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099832832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764847.411858:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:3.0:1775764847.411919:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099832832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764847.411927:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1775764847.413083:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099832832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1775764847.477960:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764848.435078:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764848.435101:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099833088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764848.435167:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764848.435241:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833088 00000100:00100000:0.0:1775764848.435249:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833088 00000100:00100000:0.0:1775764848.435301:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1775764848.435310:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099833088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764848.435338:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916951552 avail 3685429248 00000100:00100000:0.0:1775764848.435381:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099833088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764848.435388:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00080000:0.0:1775764848.435411:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764848.435445:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099833088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1775764848.435899:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099832960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764848.435933:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764848.436164:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099832960 00000100:00100000:0.0:1775764848.436180:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099832960 00000100:00100000:0.0:1775764848.436226:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1775764848.436234:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099832960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1775764848.436248:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916951552 avail 3685429248 00000100:00100000:0.0:1775764848.436296:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099832960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764848.436303:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1775764848.436348:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099832960:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1775764848.437632:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1775764848.497938:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764848.499146:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764848.499154:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764848.499871:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764848.499880:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764849.459630:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764849.459655:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099833216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764849.459724:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764849.459801:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833216 00000100:00100000:3.0:1775764849.459810:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833216 00000100:00100000:3.0:1775764849.459852:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1775764849.459860:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099833216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764849.459898:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764849.459943:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099833216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764849.459950:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1775764849.460007:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099833216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764849.522136:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764849.827585:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.828250:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.828279:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764849.828389:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153984 00000100:00100000:3.0:1775764849.828408:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153984 00000100:00100000:3.0:1775764849.828487:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1440 00000100:00100000:3.0:1775764849.828497:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076153984:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764849.828576:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076153984:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 80us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764849.828585:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1440 00000100:00080000:3.0:1775764849.828606:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764849.835111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.835154:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.835201:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764849.835376:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153728 00000100:00100000:2.0:1775764849.835387:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153728 00000100:00100000:2.0:1775764849.839451:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076154496 00000100:00100000:2.0:1775764849.839486:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076154496 00000100:00100000:2.0:1775764849.839576:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1441 00000100:00100000:2.0:1775764849.839587:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076154496:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764849.839679:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076154496:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 94us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.839688:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1441 00000100:00080000:2.0:1775764849.842917:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764849.843012:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076154240 00000100:00100000:2.0:1775764849.843024:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076154240 00000100:00100000:2.0:1775764849.843059:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1974 00000100:00100000:2.0:1775764849.843069:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+54:2408:x1862023076153728:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764849.843243:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1975 00000100:00100000:0.0:1775764849.843256:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2408:x1862023076154240:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764849.843463:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+54:2408:x1862023076153728:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 395us (15889us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.843471:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1974 00000100:00080000:2.0:1775764849.843499:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764849.847805:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153856 00000100:00100000:3.0:1775764849.847823:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153856 00000100:00100000:0.0:1775764849.847969:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:2408:x1862023076154240:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 4701us (19672us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764849.847981:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1975 00000100:00100000:0.0:1775764849.848018:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1976 00000100:00100000:0.0:1775764849.848027:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076153856:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764849.848342:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076153856:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 316us (13139us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764849.848350:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1976 00000100:00100000:1.0:1775764849.853513:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.853568:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076154112 00000100:00100000:1.0:1775764849.853579:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076154112 00000100:00100000:1.0:1775764849.853636:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1442 00000100:00100000:1.0:1775764849.853645:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2409:x1862023076154112:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764849.853705:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2409:x1862023076154112:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.853712:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1442 00000100:00100000:1.0:1775764849.853940:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076153600 00000100:00100000:1.0:1775764849.853944:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076153600 00000100:00100000:1.0:1775764849.856278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 979 00000100:00100000:1.0:1775764849.856289:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076153600:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764849.856359:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076153600:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 72us (21204us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.856367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 979 00000100:00100000:1.0:1775764849.856470:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.856498:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076154368 00000100:00100000:1.0:1775764849.856504:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076154368 00000100:00100000:1.0:1775764849.856537:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1977 00000100:00100000:1.0:1775764849.856544:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2409:x1862023076154368:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764849.856576:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2409:x1862023076154368:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.856583:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1977 00000100:00100000:1.0:1775764849.856649:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.856699:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764849.859601:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076154624 00000100:00100000:3.0:1775764849.859616:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076154624 00000100:00100000:3.0:1775764849.859861:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076154752 00000100:00100000:3.0:1775764849.859865:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076154752 00000100:00100000:3.0:1775764849.859892:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1443 00000100:00100000:3.0:1775764849.859902:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2409:x1862023076154624:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764849.861528:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2409:x1862023076154624:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 1613us (4863us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764849.861542:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1443 00000100:00100000:3.0:1775764849.861583:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1756 00000100:00100000:3.0:1775764849.861595:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076154752:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764849.861611:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764849.861631:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5612 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764849.861657:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764849.861659:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764849.861667:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 10 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764849.861701:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 10 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764849.861718:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9e00, rc 0) 00000100:00100000:3.0:1775764849.861761:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076154752:12345-192.168.202.58@tcp:101:rm.0 Request processed in 171us (5062us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764849.861768:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1756 00000100:00080000:2.0:1775764849.863902:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1775764849.863913:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764849.870871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764849.870959:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155008 00000100:00100000:2.0:1775764849.870970:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155008 00000100:00100000:2.0:1775764849.871036:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6638 00000100:00100000:2.0:1775764849.871046:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49631:x1862023076155008:12345-192.168.202.58@tcp:36:rm.0 00010000:00010000:2.0:1775764849.871105:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1775764849.871135:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2c2fa4a00/0x6e98bd47ed523e5d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd550f expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871166:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:2.0:1775764849.871190:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d800/0x6e98bd47ed524094 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55ef expref: 44 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871208:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764849.871211:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764849.871236:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871250:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871260:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871274:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871280:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871286:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871368:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871377:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871384:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871420:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.871443:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 53 pid: 6523 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764849.871459:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2e4b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099833344:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764849.871561:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff9e5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1775764849.877021:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2e4b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099833344:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764849.877053:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764849.877279:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764849.877350:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155136 00000100:00100000:1.0:1775764849.877358:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155136 00010000:00010000:1.0:1775764849.877394:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 54 pid: 6523 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764849.877445:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1433 00000100:00100000:1.0:1775764849.877456:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+54:2411:x1862023076155136:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764849.877470:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764849.877478:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 54 pid: 6523 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.877490:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 54 pid: 6523 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.877514:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed523e2c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54fa expref: 54 pid: 6523 timeout: 1457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.877528:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:1.0:1775764849.877533:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.877543:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.877550:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.877591:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764849.877648:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+53:2411:x1862023076155136:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 193us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.877656:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1433 00010000:00010000:2.0:1775764849.877949:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.877958:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1775764849.878273:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].66, 64 off13280 00000004:00080000:2.0:1775764849.878284:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1357699512499ns, next at 1358699509677ns, rc = 0 00010000:00010000:2.0:1775764849.878347:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878371:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878377:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878395:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878400:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878428:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1775764849.878451:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878462:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878469:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878475:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764849.878479:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878487:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878497:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:2.0:1775764849.878500:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1775764849.878504:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878509:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed5240f6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878530:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878541:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878547:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878552:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878557:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764849.878560:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878565:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878574:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764849.878577:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764849.878579:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed5240e8 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764849.878594:0:6521:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d7dc6f19 reply state 00000000d2592dfd transno 4294970714 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878605:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764849.878611:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c4135000) 00010000:00010000:2.0:1775764849.878617:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764849.878620:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1775764849.878686:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49631:x1862023076155008:12345-192.168.202.58@tcp:36:rm.0 Request processed in 7639us (7821us total) trans 4294970714 rc 0/0 00000100:00100000:2.0:1775764849.878694:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6638 00010000:00010000:1.0:1775764849.879309:0:9476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775764849.879317:0:9476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.879325:0:9476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2e00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764849.879329:0:9476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.879335:0:9476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.879345:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff96c1c7207300) 00010000:00010000:1.0:1775764849.879347:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1775764849.879350:0:9476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.879356:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5240fd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764849.879372:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764849.879374:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764849.879376:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764849.970048:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099833856:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970118:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764849.970179:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099834368:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970225:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764849.970243:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099834880:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970264:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764849.970286:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1775764849.970292:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099833728:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970316:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764849.970332:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099834240:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970351:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764849.970364:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099834752:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970380:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764849.970411:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833856 00000100:00100000:1.0:1775764849.970419:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833856 00000100:00100000:1.0:1775764849.970467:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1775764849.970476:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099833856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970523:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099833856:12345-0@lo:400:kworker.0 Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.970530:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1775764849.970553:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834368 00000100:00100000:1.0:1775764849.970557:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834368 00000100:00100000:1.0:1775764849.970577:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834880 00000100:00100000:1.0:1775764849.970579:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834880 00000100:00100000:1.0:1775764849.970599:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834240 00000100:00100000:1.0:1775764849.970601:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834240 00000100:00100000:1.0:1775764849.970610:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834752 00000100:00100000:1.0:1775764849.970612:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834752 00000100:00100000:1.0:1775764849.970624:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1775764849.970629:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099834368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970667:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099834368:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.970673:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1775764849.970685:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1775764849.970691:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099834880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970715:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099834880:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.970721:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1775764849.970732:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1775764849.970737:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970762:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099834240:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.970767:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1775764849.970808:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1775764849.970814:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099834752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970840:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099834752:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.970845:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1775764849.970868:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833728 00000100:00100000:1.0:1775764849.970872:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833728 00000100:00100000:1.0:1775764849.970893:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1775764849.970899:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099833728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.970930:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099833728:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.970935:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1775764849.970999:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099833728:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.971009:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099834240:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.971017:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099834752:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.971027:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099833856:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.971035:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099834368:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.971042:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099834880:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971146:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099833472:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971193:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764849.971228:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099833984:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971251:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764849.971270:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099834496:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971289:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764849.971304:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1775764849.971309:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099833600:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971325:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764849.971337:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099834112:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971352:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764849.971362:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2c8961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099834624:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971376:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1775764849.971395:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764849.971407:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833984 00000100:00100000:2.0:1775764849.971411:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833984 00000100:00100000:2.0:1775764849.971438:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834496 00000100:00100000:2.0:1775764849.971441:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834496 00000100:00100000:2.0:1775764849.971453:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833600 00000100:00100000:2.0:1775764849.971456:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833600 00000100:00100000:2.0:1775764849.971466:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834112 00000100:00100000:2.0:1775764849.971468:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834112 00000100:00100000:2.0:1775764849.971478:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099834624 00000100:00100000:2.0:1775764849.971486:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099834624 00000100:00100000:2.0:1775764849.971502:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1775764849.971507:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099833984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971539:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099833984:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.971545:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1775764849.971556:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1775764849.971561:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099834496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971582:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099834496:12345-0@lo:400:kworker.0 Request processed in 21us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.971587:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1775764849.971597:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1775764849.971601:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099833600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971619:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099833600:12345-0@lo:400:kworker.0 Request processed in 18us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.971623:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1775764849.971631:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1775764849.971635:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099834112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971654:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099834112:12345-0@lo:400:kworker.0 Request processed in 19us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.971658:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1775764849.971667:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1775764849.971671:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099834624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971693:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099834624:12345-0@lo:400:kworker.0 Request processed in 22us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764849.971706:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00080000:2.0:1775764849.971729:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1775764849.971732:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764849.971754:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099833600:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971762:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099834112:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971791:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099834624:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971800:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099833984:0@lo:400:kworker.0 00000100:00100000:2.0:1775764849.971808:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099834496:0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.972887:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099833472 00000100:00100000:1.0:1775764849.972898:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099833472 00000100:00100000:1.0:1775764849.972949:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1775764849.972958:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099833472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764849.973067:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099833472:12345-0@lo:400:kworker.0 Request processed in 111us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764849.973074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1775764849.985139:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2c8963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099833472:0@lo:400:kworker.0 00000100:00100000:0.0:1775764850.486021:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099835008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764850.486089:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764850.486227:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099835008 00000100:00100000:0.0:1775764850.486235:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099835008 00000100:00100000:0.0:1775764850.486282:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1775764850.486291:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099835008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1775764850.486328:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886530560 avail 3655008256 00000100:00100000:0.0:1775764850.486380:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099835008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764850.486427:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1775764850.486483:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099835008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764850.486606:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1775764850.486615:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099835136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764850.486645:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764850.486677:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099835136 00000100:00100000:2.0:1775764850.486681:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099835136 00000100:00100000:2.0:1775764850.486705:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1775764850.486711:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099835136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764850.486723:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886530560 avail 3655008256 00000100:00100000:2.0:1775764850.486752:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099835136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764850.486758:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1775764850.486812:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099835136:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1775764850.545948:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764851.571837:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764851.954181:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764851.954332:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155264 00000100:00100000:2.0:1775764851.954343:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155264 00000100:00100000:2.0:1775764851.954423:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6639 00000100:00100000:2.0:1775764851.954434:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49652:x1862023076155264:12345-192.168.202.58@tcp:101:ln.0 00010000:00010000:2.0:1775764851.954470:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764851.954492:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524104 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5619 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954563:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954581:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954592:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954607:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954614:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954620:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954655:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954661:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954666:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954671:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764851.954682:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954690:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954703:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764851.954706:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764851.954711:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954716:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52410b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954730:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954737:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954742:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954747:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764851.954750:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954755:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954805:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xf5a628a0 (ffff96c1c4135500) 00010000:00010000:2.0:1775764851.954808:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764851.954818:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954824:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524112 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954860:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524104 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5619 expref: 46 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954872:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:2.0:1775764851.954874:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764851.954877:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524104 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5619 expref: 46 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764851.954886:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3600, rc 0) 00000100:00100000:2.0:1775764851.954948:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49652:x1862023076155264:12345-192.168.202.58@tcp:101:ln.0 Request processed in 516us (779us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764851.954956:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6639 00000100:00080000:3.0:1775764851.955122:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764851.965058:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764851.965222:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155392 00000100:00100000:0.0:1775764851.965233:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155392 00000100:00100000:0.0:1775764851.965310:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1757 00000100:00100000:0.0:1775764851.965322:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076155392:12345-192.168.202.58@tcp:101:ln.0 00010000:00010000:0.0:1775764851.965347:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764851.965368:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed524119 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5620 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.965396:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764851.965399:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764851.965407:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed524119 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5620 expref: 11 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.965426:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a01247c2/0x6e98bd47ed524119 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5620 expref: 11 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.965441:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d800, rc 0) 00000100:00100000:0.0:1775764851.965504:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2410:x1862023076155392:12345-192.168.202.58@tcp:101:ln.0 Request processed in 184us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764851.965512:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1757 00000100:00080000:3.0:1775764851.967933:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764851.970055:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764851.970209:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155648 00000100:00100000:0.0:1775764851.970220:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155648 00000100:00100000:0.0:1775764851.970285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6640 00000100:00100000:0.0:1775764851.970303:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:49652:x1862023076155648:12345-192.168.202.58@tcp:36:ln.0 00010000:00010000:0.0:1775764851.970368:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764851.970395:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52407f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55e1 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970415:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:0.0:1775764851.970421:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1775764851.970447:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970462:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970471:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970486:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970493:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970500:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970532:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 52 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970549:0:6521:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970586:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 52 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764851.970600:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 52 pid: 10088 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764851.970614:0:6521:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099835264:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764851.970704:0:6521:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c5c0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1775764851.981745:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764851.984746:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155776 00000100:00100000:1.0:1775764851.984760:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155776 00010000:00010000:1.0:1775764851.984844:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 53 pid: 10088 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764851.984885:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1434 00000100:00100000:1.0:1775764851.984894:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:2411:x1862023076155776:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764851.984911:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764851.984917:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 53 pid: 10088 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764851.984948:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 53 pid: 10088 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764851.984973:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:1.0:1775764851.984978:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764851.984989:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764851.984997:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764851.985017:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764851.985099:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:2411:x1862023076155776:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 205us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764851.985107:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1434 00000100:00080000:3.0:1775764851.985792:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1775764851.994727:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52404e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd55cc expref: 52 pid: 10088 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764851.994751:0:6521:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1862023099835264:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764851.994803:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.994892:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.994901:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764851.995197:0:6521:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d706adad reply state 000000009bb5e4fd transno 4294970715 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995214:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995235:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764851.995238:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1775764851.995243:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1775764851.995250:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995256:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995262:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995268:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995273:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764851.995277:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995284:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995294:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764851.995296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764851.995299:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed524120 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1775764851.995315:0:6521:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d706adad reply state 000000009bb5e4fd transno 4294970715 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995330:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764851.995336:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xf5a628a0 (ffff96c2c894c200) 00010000:00010000:3.0:1775764851.995338:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1775764851.995340:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1775764851.995433:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:49652:x1862023076155648:12345-192.168.202.58@tcp:36:ln.0 Request processed in 25130us (25387us total) trans 4294970715 rc 0/0 00000100:00100000:3.0:1775764851.995455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6640 00000100:00100000:2.0:1775764852.010932:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764852.011597:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076155904 00000100:00100000:3.0:1775764852.011608:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076155904 00000100:00100000:3.0:1775764852.011670:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6641 00000100:00100000:3.0:1775764852.011680:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:49653:x1862023076155904:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764852.011703:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764852.011725:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524135 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5627 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011816:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011831:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011843:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011855:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011890:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011897:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011976:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011985:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.011991:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764852.012659:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa1:0x0]: returning size 1516 00000004:00200000:3.0:1775764852.012666:0:10088:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764852.012691:0:10088:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012704:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012713:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012719:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012727:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012744:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764852.012749:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012757:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012802:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764852.012805:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764852.012810:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012816:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed52413c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012832:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012839:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.012845:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013127:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764852.013131:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013147:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013166:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c1c2a03500) 00010000:00010000:3.0:1775764852.013169:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764852.013172:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013178:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed524143 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013220:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8a00/0x6e98bd47ed524135 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5627 expref: 48 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013235:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5627 expref: 47 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.013243:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:3.0:1775764852.013245:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764852.013247:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8000, rc 0) 00000100:00100000:3.0:1775764852.013336:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:49653:x1862023076155904:12345-192.168.202.58@tcp:101:rm.0 Request processed in 1656us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764852.013347:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6641 00000100:00100000:3.0:1775764852.024242:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764852.024743:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076156160 00000100:00100000:1.0:1775764852.024755:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076156160 00000100:00100000:1.0:1775764852.024869:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6642 00000100:00100000:1.0:1775764852.024880:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:49653:x1862023076156160:12345-192.168.202.58@tcp:36:rm.0 00010000:00010000:1.0:1775764852.024949:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764852.024978:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d8000/0x6e98bd47ed52414a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5627 expref: 47 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.024999:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:1.0:1775764852.025004:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764852.025198:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025214:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025225:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025238:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025244:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025251:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025337:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025345:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025352:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025602:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025610:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025616:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025629:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403ec00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764852.025634:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025641:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025651:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:1.0:1775764852.025654:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1775764852.025657:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025662:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed52415f lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025702:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025708:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025713:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025717:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025722:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764852.025724:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025739:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025747:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764852.025750:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764852.025753:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025759:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524151 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764852.025789:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a05eacdc reply state 000000005ac6c229 transno 4294970716 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025801:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.025807:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764852.025809:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764852.025813:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764852.027904:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:49653:x1862023076156160:12345-192.168.202.58@tcp:36:rm.0 Request processed in 3014us (3661us total) trans 4294970716 rc 0/0 00000100:00100000:1.0:1775764852.027916:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6642 00000100:00100000:3.0:1775764852.047608:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764852.047652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764852.047680:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076156288 00000100:00100000:3.0:1775764852.047691:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076156288 00000100:00100000:3.0:1775764852.047794:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1758 00000100:00100000:3.0:1775764852.047806:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076156288:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764852.047845:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764852.048181:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd562e expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.048209:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764852.048212:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764852.048221:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 9 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.048238:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 9 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.048254:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d8a00, rc 0) 00000100:00100000:3.0:1775764852.048966:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076156288:12345-192.168.202.58@tcp:101:rm.0 Request processed in 1159us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764852.048975:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1758 00000100:00100000:3.0:1775764852.049012:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076156416 00000100:00100000:3.0:1775764852.049019:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076156416 00000100:00100000:3.0:1775764852.049070:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1439 00000100:00100000:3.0:1775764852.049078:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:2408:x1862023076156416:12345-192.168.202.58@tcp:63:ll_sa.0 00010000:00010000:3.0:1775764852.049132:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764852.049159:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52416d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5635 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049218:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049242:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049252:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049264:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049271:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049276:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049316:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049323:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049329:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049334:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8d9c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764852.049339:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049346:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049363:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764852.049373:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764852.049379:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049385:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9c00/0x6e98bd47ed524174 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049397:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049402:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049407:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049412:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764852.049415:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049421:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049427:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c2c7e0fa00) 00010000:00010000:3.0:1775764852.049430:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764852.049433:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049437:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52417b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049462:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52416d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5635 expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049477:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764852.049478:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1775764852.049482:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9600/0x6e98bd47ed52416d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5635 expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764852.049490:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8d9600, rc -2) 00000100:00100000:3.0:1775764852.052783:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:2408:x1862023076156416:12345-192.168.202.58@tcp:63:ll_sa.0 Request processed in 3678us (5102us total) trans 0 rc -2/-2 00000100:00100000:3.0:1775764852.052799:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1439 00000100:00080000:3.0:1775764852.052845:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764852.067926:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764852.068227:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076156672 00000100:00100000:2.0:1775764852.068238:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076156672 00000100:00100000:2.0:1775764852.068302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6643 00000100:00100000:2.0:1775764852.068324:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+48:49654:x1862023076156672:12345-192.168.202.58@tcp:36:rm.0 00010000:00010000:2.0:1775764852.068401:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764852.068430:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed523f6e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5578 expref: 48 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068460:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:2.0:1775764852.068466:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764852.068494:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068510:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068520:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068535:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068541:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068548:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068641:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068652:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068672:0:6523:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068710:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 51 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764852.068725:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 51 pid: 24980 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764852.068742:0:6523:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1862023099835392:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764852.068876:0:6523:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c6354780 going to sleep for 11 seconds 00000100:00100000:2.0:1775764852.075565:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764852.075622:0:6523:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1862023099835392:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764852.075650:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764852.076413:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076156800 00000100:00100000:1.0:1775764852.076421:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076156800 00010000:00010000:1.0:1775764852.076469:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 52 pid: 24980 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764852.076507:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1435 00000100:00100000:1.0:1775764852.076516:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+52:2410:x1862023076156800:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764852.076538:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764852.076545:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 52 pid: 24980 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076558:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 52 pid: 24980 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076582:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed523f3d lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5563 expref: 52 pid: 24980 timeout: 1459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076596:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:1.0:1775764852.076601:0:24971:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076610:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076618:0:24971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076643:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764852.076696:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+51:2410:x1862023076156800:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 181us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764852.076704:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1435 00010000:00010000:1.0:1775764852.076727:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.076735:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1775764852.083198:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].69, 64 off13448 00000004:00080000:1.0:1775764852.083210:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1359904438898ns, next at 1360904436582ns, rc = 0 00010000:00010000:1.0:1775764852.083280:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083297:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083309:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083317:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083323:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083329:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083358:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:1.0:1775764852.083415:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].156, 136 off29200 00010000:00010000:1.0:1775764852.083439:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083446:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083452:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083476:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764852.083481:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083489:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083502:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:1.0:1775764852.083505:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1775764852.083510:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083516:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed524190 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083543:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083549:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083554:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083559:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083565:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764852.083568:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083584:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083592:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:1.0:1775764852.083595:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764852.083598:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083603:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524182 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764852.083614:0:6523:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000689f1f75 reply state 00000000c015ea85 transno 4294970717 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083625:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c1c4135500) 00010000:00010000:1.0:1775764852.083633:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764852.083636:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764852.083729:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+49:49654:x1862023076156672:12345-192.168.202.58@tcp:36:rm.0 Request processed in 15402us (15807us total) trans 4294970717 rc 0/0 00000100:00100000:1.0:1775764852.083739:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6643 00010000:00010000:1.0:1775764852.083813:0:6508:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775764852.083820:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083827:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f600 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764852.083831:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.083847:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.086718:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c2c6356900) 00010000:00010000:1.0:1775764852.086723:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1775764852.086731:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.086738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed524197 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764852.086796:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764852.086799:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764852.086801:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764852.534737:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099835520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764852.534825:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764852.537321:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099835520 00000100:00100000:1.0:1775764852.537341:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099835520 00000100:00100000:1.0:1775764852.537411:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1775764852.537422:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099835520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764852.537461:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:1.0:1775764852.551319:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099835520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13888us (16482us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764852.551335:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1775764852.551725:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099835520:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764852.593943:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764853.132595:0:31847:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764853.132604:0:31847:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764853.132652:0:31847:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:3.0:1775764853.132659:0:31847:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1775764853.554030:0:8640:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1361375256694ns, next at 1362375253973ns, rc = 0 00000100:00100000:2.0:1775764853.554720:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775764853.554747:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099835648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764853.554881:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764853.555441:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1775764853.555455:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099835776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1775764853.555489:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764853.555803:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099835648 00000100:00100000:3.0:1775764853.555811:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099835648 00000100:00100000:3.0:1775764853.555876:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099835776 00000100:00100000:3.0:1775764853.555879:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099835776 00000100:00100000:3.0:1775764853.555899:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1775764853.555908:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099835648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1775764853.555937:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916951552 avail 3685429248 00000100:00100000:3.0:1775764853.556003:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099835648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764853.556011:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1775764853.556028:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1775764853.556034:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099835776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1775764853.556044:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916951552 avail 3685429248 00000100:00100000:3.0:1775764853.556075:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099835776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764853.556080:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1775764853.556215:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099835776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1775764853.556831:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099835648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1775764853.557237:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1775764853.618030:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764854.578943:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099835904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764854.579016:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764854.579103:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099835904 00000100:00100000:0.0:1775764854.579110:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099835904 00000100:00100000:0.0:1775764854.579169:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1775764854.579177:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099835904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1775764854.579216:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:0.0:1775764854.579271:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099835904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764854.579278:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1775764854.579329:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099835904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1775764854.647194:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764854.934577:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934666:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934724:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934743:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934760:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934804:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764854.934836:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076156928 00000100:00100000:2.0:1775764854.934845:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076156928 00000100:00100000:2.0:1775764854.935175:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 981 00000100:00100000:2.0:1775764854.935187:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076156928:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.935263:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076156928:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 79us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.935271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 981 00000100:00100000:2.0:1775764854.935306:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157184 00000100:00100000:2.0:1775764854.935310:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157184 00000100:00100000:2.0:1775764854.935347:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157696 00000100:00100000:2.0:1775764854.935350:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157696 00000100:00100000:2.0:1775764854.935368:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157056 00000100:00100000:2.0:1775764854.935371:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157056 00000100:00100000:2.0:1775764854.935389:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157568 00000100:00100000:2.0:1775764854.935391:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157568 00000100:00100000:2.0:1775764854.935525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1984 00000100:00100000:2.0:1775764854.935534:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076157184:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.935578:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076157184:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 47us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.935585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1984 00000100:00100000:2.0:1775764854.935599:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1985 00000100:00100000:2.0:1775764854.935605:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076157696:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.935630:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076157696:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.935644:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1985 00000100:00100000:2.0:1775764854.935658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1986 00000100:00100000:2.0:1775764854.935664:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076157056:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.935690:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076157056:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.935696:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1986 00000100:00100000:2.0:1775764854.935708:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1987 00000100:00100000:2.0:1775764854.935714:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+49:2411:x1862023076157568:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.935740:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+49:2411:x1862023076157568:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.935746:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1987 00000100:00100000:2.0:1775764854.935765:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157440 00000100:00100000:2.0:1775764854.935789:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157440 00000100:00100000:2.0:1775764854.935815:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157952 00000100:00100000:2.0:1775764854.935818:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157952 00000100:00100000:2.0:1775764854.935835:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157312 00000100:00100000:2.0:1775764854.935837:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157312 00000100:00100000:2.0:1775764854.935850:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076157824 00000100:00100000:2.0:1775764854.935852:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076157824 00000100:00100000:2.0:1775764854.935863:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1448 00000100:00100000:2.0:1775764854.935868:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076157440:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.936288:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076157440:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.936298:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1448 00000100:00100000:2.0:1775764854.936314:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1449 00000100:00100000:2.0:1775764854.936330:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2411:x1862023076157952:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.936359:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2411:x1862023076157952:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 31us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.936366:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1449 00000100:00100000:2.0:1775764854.936378:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1450 00000100:00100000:2.0:1775764854.936384:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076157312:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.936407:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076157312:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.936428:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1450 00000100:00100000:2.0:1775764854.936439:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1451 00000100:00100000:2.0:1775764854.936445:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076157824:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764854.936467:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2411:x1862023076157824:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764854.936473:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1451 00000100:00080000:2.0:1775764854.938028:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1775764854.938035:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1775764854.938039:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764854.938042:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1775764855.065265:0:31898:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764855.065275:0:31898:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764855.065316:0:31898:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:3.0:1775764855.065324:0:31898:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764855.104311:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099836160:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.104413:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764855.104599:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099836032:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.104619:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099836672:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.106216:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.106258:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099837184:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.106287:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.106335:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099836288:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.106375:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.106401:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099836800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.107337:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.107385:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099837312:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.107506:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.107533:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1775764855.107540:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099836416:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.107564:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.107594:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099836928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.107615:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.107634:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099837440:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.107744:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764855.109099:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836288 00000100:00100000:2.0:1775764855.109123:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836288 00000100:00100000:2.0:1775764855.109191:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1775764855.109201:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099836288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764855.109283:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099836288:12345-0@lo:400:kworker.0 Request processed in 83us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764855.109291:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1775764855.109313:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099836288:0@lo:400:kworker.0 00000100:00100000:2.0:1775764855.109336:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836160 00000100:00100000:2.0:1775764855.109342:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836160 00000100:00100000:3.0:1775764855.109351:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836800 00000100:00100000:3.0:1775764855.109356:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836800 00000100:00100000:2.0:1775764855.109373:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836672 00000100:00100000:2.0:1775764855.109378:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836672 00000100:00100000:2.0:1775764855.109406:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837184 00000100:00100000:2.0:1775764855.109409:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837184 00000100:00100000:2.0:1775764855.109431:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836416 00000100:00100000:2.0:1775764855.109433:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836416 00000100:00100000:2.0:1775764855.109447:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1775764855.109453:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099836160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764855.109493:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099836160:12345-0@lo:400:kworker.0 Request processed in 40us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764855.109498:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1775764855.109510:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1775764855.109516:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099836672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764855.109544:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099836672:12345-0@lo:400:kworker.0 Request processed in 28us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764855.109550:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1775764855.109561:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:2.0:1775764855.109567:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099837184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764855.109594:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099837184:12345-0@lo:400:kworker.0 Request processed in 27us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764855.109599:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:2.0:1775764855.109610:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:2.0:1775764855.109615:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099836416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764855.109645:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099836416:12345-0@lo:400:kworker.0 Request processed in 31us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764855.109660:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1775764855.110058:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837312 00000100:00100000:3.0:1775764855.110063:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837312 00000100:00100000:3.0:1775764855.110096:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836928 00000100:00100000:3.0:1775764855.110099:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836928 00000100:00100000:3.0:1775764855.110122:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837440 00000100:00100000:3.0:1775764855.110125:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837440 00000100:00100000:3.0:1775764855.110140:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1775764855.110155:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099836800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110194:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099836800:12345-0@lo:400:kworker.0 Request processed in 49us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.110200:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1775764855.110212:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1775764855.110217:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099837312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110244:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099837312:12345-0@lo:400:kworker.0 Request processed in 26us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.110249:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1775764855.110270:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1775764855.110275:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099836928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110302:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099836928:12345-0@lo:400:kworker.0 Request processed in 27us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.110308:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1775764855.110316:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1775764855.110322:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099837440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110343:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099837440:12345-0@lo:400:kworker.0 Request processed in 22us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.110349:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00080000:3.0:1775764855.110389:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764855.110394:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764855.110396:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764855.110911:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099836160:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110924:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099836672:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110934:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099837184:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.110970:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099836416:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.111123:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099836928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.111138:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099837440:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.111148:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099836800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.111157:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099837312:0@lo:400:kworker.0 00000100:00100000:0.0:1775764855.113482:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764855.113547:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099836544:0@lo:400:kworker.0 00000100:00100000:0.0:1775764855.113607:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764855.113638:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099837056:0@lo:400:kworker.0 00000100:00100000:0.0:1775764855.113663:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.113723:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836544 00000100:00100000:0.0:1775764855.113727:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099836032 00000100:00100000:3.0:1775764855.113731:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836544 00000100:00100000:0.0:1775764855.113733:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099836032 00000100:00100000:0.0:1775764855.113808:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1775764855.113820:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099836032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.113831:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837056 00000100:00100000:3.0:1775764855.113836:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837056 00000100:00100000:3.0:1775764855.113866:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1775764855.113875:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099836544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764855.113882:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3661:x1862023099836032:12345-0@lo:400:kworker.0 Request processed in 63us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764855.113891:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1775764855.113925:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1862023099836544:12345-0@lo:400:kworker.0 Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.113932:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1775764855.113938:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1775764855.113947:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099837056:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1775764855.113955:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764855.113982:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1862023099837056:12345-0@lo:400:kworker.0 Request processed in 36us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764855.113987:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1775764855.114022:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3661:1862023099836032:0@lo:400:kworker.0 00000100:00100000:0.0:1775764855.114033:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3661:1862023099836544:0@lo:400:kworker.0 00000100:00100000:0.0:1775764855.114041:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3661:1862023099837056:0@lo:400:kworker.0 00000100:00100000:3.0:1775764855.602098:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775764855.602157:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099837568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764855.602220:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1775764855.602293:0:9674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1363423520300ns, next at 1364423517961ns, rc = 0 00000100:00100000:1.0:1775764855.602342:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764855.602352:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099837696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1775764855.604473:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1775764855.613254:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00000004:00080000:3.0:1775764855.613289:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00000001:00080000:3.0:1775764855.613324:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970717 is committed 00000004:00080000:3.0:1775764855.613329:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000004:00080000:3.0:1775764855.613338:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000100:00100000:3.0:1775764855.613465:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099837824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1775764855.613528:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764855.613589:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837824 00000100:00100000:3.0:1775764855.613596:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837824 00000100:00100000:3.0:1775764855.613655:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:3.0:1775764855.613675:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099837824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1775764855.613702:0:24969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:87 count 1 00010000:00010000:3.0:1775764855.613727:0:24969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.613750:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 6 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.613799:0:24969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 8 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.613830:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764855.613832:0:24969:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764855.613836:0:24969:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 5/0,1 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.613866:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 8 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.613880:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 8 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.613976:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3665c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099837952:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764855.614047:0:24969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 6 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.614058:0:24969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 6 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.614067:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3666300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099838080:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764855.614091:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d6724780 going to sleep for 11 seconds 00000100:00100000:1.0:1775764855.614331:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764855.614340:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099838208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1775764855.614371:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1775764855.614412:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614422:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614429:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614434:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764855.614438:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614445:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614461:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xa0996281 (ffff96c1c4135000) 00010000:00010000:1.0:1775764855.614464:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764855.614468:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614473:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed5240ef lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xa0996281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614496:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614508:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.614512:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099838208 00010000:00010000:1.0:1775764855.614514:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.614518:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099838208 00010000:00010000:1.0:1775764855.614522:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764855.614526:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614531:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614539:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xf5a628a0 (ffff96c2c894c200) 00010000:00010000:1.0:1775764855.614542:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764855.614545:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614550:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524127 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xf5a628a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.614552:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:3.0:1775764855.614563:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099838208:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1775764855.614568:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614574:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1775764855.614578:0:8402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:87 count 1 00010000:00010000:1.0:1775764855.614579:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614586:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764855.614594:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614595:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614614:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.614620:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614625:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff96c1c2a04300) 00010000:00010000:1.0:1775764855.614630:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1775764855.614634:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.614635:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 10 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614649:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed52412e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.614652:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764855.614656:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764855.614666:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614672:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614677:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614682:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764855.614685:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614690:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614697:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xe2ae3511 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764855.614699:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764855.614708:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614715:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed524158 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0xe2ae3511 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614729:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614735:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614740:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614744:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764855.614747:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614753:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614761:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x10895866 (ffff96c1c4135500) 00010000:00010000:1.0:1775764855.614763:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764855.614765:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.614802:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524189 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x17:0x0].0x10895866 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.616265:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.616327:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 10 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.616340:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 10 pid: 24969 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.616356:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099838336:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764855.616471:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.616493:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 8 pid: 8403 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.616504:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3665880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099838464:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764855.616531:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c4ff2600 going to sleep for 11 seconds 00000100:00100000:0.0:1775764855.619249:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837568 00000100:00100000:0.0:1775764855.619265:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837568 00000100:00100000:0.0:1775764855.619360:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099837696 00000100:00100000:0.0:1775764855.619364:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099837696 00000100:00100000:0.0:1775764855.619382:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1775764855.619391:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099837568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1775764855.619425:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886530560 avail 3655008256 00000100:00100000:3.0:1775764855.619476:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:3.0:1775764855.619485:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099837696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1775764855.619497:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886530560 avail 3655008256 00000100:00100000:0.0:1775764855.619510:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099837568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (17289us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764855.619517:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1775764855.619529:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099837696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (15066us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.619535:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1775764855.619583:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099837568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764855.621296:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099837696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764855.637489:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764855.637549:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3665c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099837952:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764855.638895:0:6507:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076158080 00000100:00100000:0.0:1775764855.638909:0:6507:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076158080 00010000:00010000:0.0:1775764855.638958:0:6507:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 9 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764855.639001:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1436 00000100:00100000:0.0:1775764855.639011:0:6507:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2410:x1862023076158080:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764855.639031:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764855.639036:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 9 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764855.639051:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 9 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764855.639077:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4c5b7b/0x6e98bd47ed524166 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd562e expref: 9 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764855.639136:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764855.641949:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764855.641989:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764855.642121:0:25199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076158336 00000100:00100000:2.0:1775764855.642129:0:25199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076158336 00000100:00100000:1.0:1775764855.642274:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099838336:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764855.642290:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076158208 00000100:00100000:1.0:1775764855.642308:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076158208 00010000:00010000:1.0:1775764855.642339:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 7 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764855.642375:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1437 00000100:00100000:1.0:1775764855.642384:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076158208:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764855.642398:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764855.642404:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 7 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.642416:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 7 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.642442:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764855.642444:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764855.642449:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.642458:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.642477:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764855.642532:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076158208:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 149us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764855.642539:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1437 00000100:00100000:1.0:1775764855.642577:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3665880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099838464:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764855.642599:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.642749:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067478864/0x6e98bd47ed523fad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd559b expref: 6 pid: 8641 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.642766:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3666300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099838080:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764855.643001:0:24969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.643051:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764855.643074:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076158464 00000100:00100000:3.0:1775764855.643079:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076158464 00010000:00010000:3.0:1775764855.643098:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 9 pid: 8403 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764855.643144:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1438 00000100:00100000:3.0:1775764855.643152:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076158464:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764855.643164:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764855.643168:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 9 pid: 8403 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643178:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 9 pid: 8403 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643201:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d3b977f/0x6e98bd47ed523e9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5532 expref: 9 pid: 8403 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643214:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764855.643239:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076158464:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764855.643247:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1438 00010000:00010000:2.0:1775764855.643264:0:25199:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 11 pid: 24969 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643281:0:24969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643290:0:24969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764855.643295:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1439 00010000:00010000:3.0:1775764855.643306:0:24969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764855.643307:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+11:2410:x1862023076158336:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764855.643320:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764855.643326:0:25199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 11 pid: 24969 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643344:0:24969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.643349:0:25199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 11 pid: 24969 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.643371:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a17293/0x6e98bd47ed5240e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5612 expref: 11 pid: 24969 timeout: 1463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643372:0:24969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1775764855.643384:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764855.643386:0:25199:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764855.643389:0:25199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643390:0:6508:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764855.643398:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.643415:0:25199:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.643435:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764855.643456:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076158336:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 152us (1519us total) trans 0 rc 0/0 00010000:00010000:3.0:1775764855.643501:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764855.643506:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643516:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643529:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbd59d1f/0x6e98bd47ed52419e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.643552:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764855.643553:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764855.643555:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764855.644233:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3663:x1862023099837824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30156us (30291us total) trans 4294967730 rc 0/0 00000100:00100000:3.0:1775764855.644259:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:2.0:1775764855.644261:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1439 00000004:00080000:3.0:1775764855.644321:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c1c3664a80/2, rc 0, transno 4294967730 00000100:00100000:3.0:1775764855.644330:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099837824:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1775764855.644485:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.644497:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.644508:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.644515:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764855.644543:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1775764855.646131:0:6507:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076158080:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 7111us (8643us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764855.646144:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1436 00010000:00010000:3.0:1775764855.647031:0:9476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1775764855.647041:0:9476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.647054:0:9476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6c400 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764855.647058:0:9476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.647068:0:9476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.647090:0:9476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.647097:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008067c08e/0x6e98bd47ed5241a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.647129:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764855.647131:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1775764855.647133:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764855.647178:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1862023099838208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32613us (32802us total) trans 4294967731 rc 0/0 00000100:00100000:1.0:1775764855.647189:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000004:00080000:2.0:1775764855.647989:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c1c3771500/2, rc 0, transno 4294967731 00000100:00100000:2.0:1775764855.648000:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099838208:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1775764855.666057:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764855.922012:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764855.922022:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764855.922056:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:2.0:1775764855.922067:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764855.922272:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099838592:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764855.922483:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d55ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1775764855.935867:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099838592:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1775764855.944472:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764855.944555:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076158592 00000100:00100000:2.0:1775764855.944565:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076158592 00000100:00100000:2.0:1775764855.944648:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6644 00000100:00100000:2.0:1775764855.944657:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+51:49675:x1862023076158592:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1775764855.944692:0:10681:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1775764855.944767:0:10681:0:(mdt_handler.c:7999:mdt_fid2path()) nonlocal object [0x200000403:0xa0:0x0]: rc = -2 00000100:00100000:2.0:1775764855.944859:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+51:49675:x1862023076158592:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 203us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1775764855.944884:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6644 00000100:00100000:1.0:1775764855.955752:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764855.955811:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076158848 00000100:00100000:3.0:1775764855.955833:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076158848 00000100:00100000:3.0:1775764855.955904:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6645 00000100:00100000:3.0:1775764855.955915:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+51:49675:x1862023076158848:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764855.955953:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764855.955975:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed5241ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd566d expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.956169:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed5241ac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd566d expref: 52 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.956184:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764855.956187:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1775764855.956193:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed5241ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd566d expref: 52 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764855.956208:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6c400, rc 0) 00000100:00100000:3.0:1775764855.956272:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+51:49675:x1862023076158848:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 359us (532us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764855.956279:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6645 00000100:00100000:3.0:1775764855.961746:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764855.961941:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159104 00000100:00100000:2.0:1775764855.961952:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159104 00000100:00100000:2.0:1775764855.962031:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6646 00000100:00100000:2.0:1775764855.962041:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+51:49675:x1862023076159104:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1775764855.962191:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962208:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962220:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962230:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962248:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962255:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962261:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764855.962265:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962272:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962302:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff96c1c7207e00) 00010000:00010000:2.0:1775764855.962305:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1775764855.962309:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764855.962314:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed5241b3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764855.963423:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+51:49675:x1862023076159104:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 1376us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764855.963435:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6646 00000040:00080000:1.0:1775764855.967094:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764855.967115:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764855.967592:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1775764855.967605:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1775764856.690544:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764857.178691:0:31950:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764857.178702:0:31950:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764857.178753:0:31950:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:1.0:1775764857.178760:0:31950:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764857.651537:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775764857.651569:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099838720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764857.651643:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764857.651829:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099838720 00000100:00100000:1.0:1775764857.651853:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099838720 00000100:00100000:1.0:1775764857.651912:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1775764857.651921:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099838720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764857.651960:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:1.0:1775764857.652027:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099838720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764857.652034:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1775764857.652144:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099838720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1775764857.719644:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1775764858.249455:0:32001:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764858.249464:0:32001:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764858.249503:0:32001:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:0.0:1775764858.249512:0:32001:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764858.674916:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099838976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764858.674986:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764858.675124:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099838976 00000100:00100000:3.0:1775764858.675132:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099838976 00000100:00100000:2.0:1775764858.675167:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1775764858.675179:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764858.675196:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:3.0:1775764858.675205:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099838976:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1775764858.675208:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1775764858.675236:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00100000:2.0:1775764858.675238:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099838848 00000100:00100000:2.0:1775764858.675241:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099838848 00000100:00100000:2.0:1775764858.675261:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1775764858.675267:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099838848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1775764858.675276:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00100000:3.0:1775764858.675280:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099838976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764858.675299:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1775764858.675300:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099838848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764858.675304:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1775764858.675340:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099838848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1775764858.675410:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764858.675434:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099838976:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1775764858.737979:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764858.737987:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764858.738519:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764858.738530:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1775764858.739039:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764859.338040:0:32051:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764859.338053:0:32051:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764859.340287:0:32051:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:3.0:1775764859.340298:0:32051:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764859.698195:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764859.698220:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099839104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764859.698294:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764859.698425:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839104 00000100:00100000:2.0:1775764859.698435:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839104 00000100:00100000:2.0:1775764859.698496:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1775764859.698524:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099839104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1775764859.698568:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:2.0:1775764859.698640:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099839104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764859.698648:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1775764859.698798:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099839104:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764859.762877:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764860.048798:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049185:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049227:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049249:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049285:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049304:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049322:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764860.049394:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159744 00000100:00100000:3.0:1775764860.049404:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159744 00000100:00100000:3.0:1775764860.049461:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160256 00000100:00100000:3.0:1775764860.049464:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160256 00000100:00100000:3.0:1775764860.049486:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159616 00000100:00100000:3.0:1775764860.049489:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159616 00000100:00100000:3.0:1775764860.049504:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160128 00000100:00100000:3.0:1775764860.049506:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160128 00000100:00100000:2.0:1775764860.049529:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159232 00000100:00100000:3.0:1775764860.049534:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1456 00000100:00100000:2.0:1775764860.049537:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159232 00000100:00100000:3.0:1775764860.049545:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076159744:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.049577:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 983 00000100:00100000:2.0:1775764860.049587:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076159232:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764860.049621:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076159744:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 77us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.049625:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076159232:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 39us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.049633:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 983 00000100:00100000:2.0:1775764860.049683:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1457 00000100:00100000:2.0:1775764860.049690:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076160256:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.049716:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076160256:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.049723:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1457 00000100:00100000:2.0:1775764860.049737:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1458 00000100:00100000:2.0:1775764860.049744:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076159616:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.049767:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+6:2410:x1862023076159616:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.049790:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1458 00000100:00100000:2.0:1775764860.049802:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1459 00000100:00100000:2.0:1775764860.049808:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076160128:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.049842:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076160128:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.049849:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1459 00000100:00100000:2.0:1775764860.049906:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159488 00000100:00100000:2.0:1775764860.049910:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159488 00000100:00100000:2.0:1775764860.049938:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160000 00000100:00100000:2.0:1775764860.049942:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160000 00000100:00100000:2.0:1775764860.049961:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159360 00000100:00100000:2.0:1775764860.049965:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159360 00000100:00100000:2.0:1775764860.049983:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076159872 00000100:00100000:2.0:1775764860.049986:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076159872 00000100:00100000:2.0:1775764860.050003:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1994 00000100:00100000:2.0:1775764860.050009:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076159488:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.050037:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076159488:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.050044:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1994 00000100:00100000:2.0:1775764860.050060:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1995 00000100:00100000:2.0:1775764860.050082:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076160000:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.050106:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076160000:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.050112:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1995 00000100:00100000:2.0:1775764860.050127:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1996 00000100:00100000:2.0:1775764860.050133:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:2410:x1862023076159360:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.050157:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:2410:x1862023076159360:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.050173:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1996 00000100:00100000:2.0:1775764860.050200:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1997 00000100:00100000:2.0:1775764860.050207:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:2410:x1862023076159872:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764860.050229:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:2410:x1862023076159872:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.050235:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1997 00000100:00080000:2.0:1775764860.050284:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764860.050289:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1775764860.050292:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1775764860.050293:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764860.051488:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1456 00000100:00100000:3.0:1775764860.210000:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099839488:0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.210098:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764860.210156:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099840000:0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.210180:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764860.210204:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099840512:0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.210224:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764860.210248:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1775764860.210254:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099839616:0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.210275:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764860.210294:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099840128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.210316:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764860.210331:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099840640:0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.210350:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764860.210391:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839488 00000100:00100000:3.0:1775764860.210398:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839488 00000100:00100000:1.0:1775764860.210582:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099839360:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210611:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210628:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099839872:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210645:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210658:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099840384:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210676:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210692:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1775764860.210697:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2ff823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099839232:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210724:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210747:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099839744:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210808:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210822:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099840256:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210842:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210854:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099840768:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210872:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764860.210895:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839232 00000100:00100000:1.0:1775764860.210900:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839232 00000100:00100000:1.0:1775764860.210939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1775764860.210950:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099839232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.210999:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099839232:12345-0@lo:400:kworker.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764860.211006:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1775764860.211059:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099839232:0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.211440:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840000 00000100:00100000:2.0:1775764860.211445:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840000 00000100:00100000:2.0:1775764860.211760:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840512 00000100:00100000:2.0:1775764860.211764:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840512 00000100:00100000:2.0:1775764860.211806:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839616 00000100:00100000:2.0:1775764860.211809:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839616 00000100:00100000:2.0:1775764860.211822:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839360 00000100:00100000:2.0:1775764860.211824:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839360 00000100:00100000:2.0:1775764860.211834:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839872 00000100:00100000:2.0:1775764860.211837:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839872 00000100:00100000:2.0:1775764860.211849:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840384 00000100:00100000:2.0:1775764860.211851:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840384 00000100:00100000:2.0:1775764860.211870:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1775764860.211877:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099840000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.211935:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099840000:12345-0@lo:400:kworker.0 Request processed in 58us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.211941:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1775764860.211971:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1775764860.211988:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099840512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212017:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099840512:12345-0@lo:400:kworker.0 Request processed in 31us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212022:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1775764860.212042:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1775764860.212047:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099839616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212079:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099839616:12345-0@lo:400:kworker.0 Request processed in 32us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212084:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1775764860.212095:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1775764860.212099:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099839360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212124:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099839360:12345-0@lo:400:kworker.0 Request processed in 25us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212129:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1775764860.212138:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1775764860.212142:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099839872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212160:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099839872:12345-0@lo:400:kworker.0 Request processed in 18us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212165:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1775764860.212172:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1775764860.212176:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099840384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212193:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099840384:12345-0@lo:400:kworker.0 Request processed in 17us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212198:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1775764860.212220:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840128 00000100:00100000:2.0:1775764860.212228:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840128 00000100:00100000:2.0:1775764860.212250:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840640 00000100:00100000:2.0:1775764860.212252:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840640 00000100:00100000:2.0:1775764860.212265:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840256 00000100:00100000:2.0:1775764860.212267:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840256 00000100:00100000:2.0:1775764860.212275:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840768 00000100:00100000:2.0:1775764860.212277:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840768 00000100:00100000:2.0:1775764860.212288:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1775764860.212293:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099840128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212322:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099840128:12345-0@lo:400:kworker.0 Request processed in 28us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212327:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1775764860.212337:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1775764860.212343:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099840640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212384:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099840640:12345-0@lo:400:kworker.0 Request processed in 42us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212390:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1775764860.212401:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1775764860.212407:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099840256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764860.212431:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099840256:12345-0@lo:400:kworker.0 Request processed in 25us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212436:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1775764860.212446:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1775764860.212452:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099840768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764860.212848:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099839744 00000100:00100000:3.0:1775764860.212853:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099839744 00000100:00100000:2.0:1775764860.212915:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099840768:12345-0@lo:400:kworker.0 Request processed in 465us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.212920:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1775764860.217289:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1775764860.217316:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099839488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.217414:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099839488:12345-0@lo:400:kworker.0 Request processed in 115us (7315us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764860.217421:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1775764860.217455:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1775764860.217463:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099839744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.217494:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099839744:12345-0@lo:400:kworker.0 Request processed in 32us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764860.217499:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00080000:1.0:1775764860.218206:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764860.218214:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1775764860.218230:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1775764860.218233:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764860.218534:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099839616:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.218552:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099840128:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.218563:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099840640:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.218575:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099839488:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.218585:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099840000:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.218692:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099840512:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.218750:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099839744:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.219180:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099840256:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.219193:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099840768:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.219205:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2ff823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099839360:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.219216:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099839872:0@lo:400:kworker.0 00000100:00100000:1.0:1775764860.219229:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099840384:0@lo:400:kworker.0 00000100:00100000:0.0:1775764860.723902:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099840896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764860.723966:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764860.724039:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099840896 00000100:00100000:0.0:1775764860.724045:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099840896 00000100:00100000:0.0:1775764860.724100:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1775764860.724108:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099840896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1775764860.724135:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:0.0:1775764860.724186:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1862023099840896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764860.724192:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1775764860.724242:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099840896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764860.724636:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099841024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764860.724664:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764860.724913:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841024 00000100:00100000:2.0:1775764860.724919:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841024 00000100:00100000:2.0:1775764860.724949:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1775764860.724957:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099841024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764860.724971:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:2.0:1775764860.725007:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099841024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764860.725014:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1775764860.725239:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099841024:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1775764860.786123:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1775764861.246278:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967730 is committed 00000001:00080000:3.0:1775764861.258374:0:9467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967731 is committed 00010000:00010000:1.0:1775764861.818191:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764862.770163:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1775764862.770184:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099841152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1775764862.770256:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764862.770556:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841152 00000100:00100000:0.0:1775764862.770566:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841152 00000100:00100000:0.0:1775764862.770621:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1775764862.770630:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099841152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1775764862.770666:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:0.0:1775764862.771824:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099841152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1186us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764862.771836:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1775764862.778712:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099841152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1775764862.839831:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764863.794218:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1775764863.794240:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099841280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764863.794310:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764863.794382:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841280 00000100:00100000:2.0:1775764863.794390:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841280 00000100:00100000:2.0:1775764863.794443:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1775764863.794453:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099841280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1775764863.794495:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00100000:2.0:1775764863.794539:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099841280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764863.794545:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1775764863.794586:0:3662:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967730 gen 2 00000004:00080000:2.0:1775764863.794591:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c1c3664a80, transno 4294967730 00000100:00100000:2.0:1775764863.794606:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099841280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1775764863.794875:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764863.795865:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764863.795884:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099841408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764863.795937:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764863.796191:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841408 00000100:00100000:0.0:1775764863.796199:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841408 00000100:00100000:0.0:1775764863.796297:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1775764863.796307:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099841408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1775764863.796331:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00100000:0.0:1775764863.796385:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099841408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764863.796393:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1775764863.797039:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099841408:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1775764863.803133:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1775764863.858523:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764864.820931:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099841536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764864.821034:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764864.821252:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841536 00000100:00100000:1.0:1775764864.821267:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841536 00000100:00100000:1.0:1775764864.821325:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1775764864.821333:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099841536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764864.821368:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1775764864.821413:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099841536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764864.821420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1775764864.822939:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099841536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1775764864.883047:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764865.162247:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162296:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162332:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162378:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162398:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162416:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162434:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162457:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764865.162483:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160512 00000100:00100000:0.0:1775764865.162493:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160512 00000100:00100000:0.0:1775764865.162549:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161024 00000100:00100000:0.0:1775764865.162552:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161024 00000100:00100000:0.0:1775764865.162568:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160640 00000100:00100000:0.0:1775764865.162571:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160640 00000100:00100000:0.0:1775764865.162627:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161152 00000100:00100000:0.0:1775764865.162630:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161152 00000100:00100000:0.0:1775764865.162646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2004 00000100:00100000:0.0:1775764865.162655:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:2408:x1862023076160512:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.162747:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:2408:x1862023076160512:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 92us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.162755:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2004 00000100:00100000:0.0:1775764865.162798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2005 00000100:00100000:0.0:1775764865.162805:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:2408:x1862023076161024:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.162830:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:2408:x1862023076161024:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.162846:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2005 00000100:00100000:0.0:1775764865.162860:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2006 00000100:00100000:0.0:1775764865.162870:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076160640:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.162898:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+15:2409:x1862023076160640:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.162904:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2006 00000100:00100000:0.0:1775764865.162914:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2007 00000100:00100000:0.0:1775764865.162920:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2409:x1862023076161152:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.162939:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2409:x1862023076161152:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 19us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.162944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2007 00000100:00100000:0.0:1775764865.162981:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160768 00000100:00100000:0.0:1775764865.162986:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160768 00000100:00100000:0.0:1775764865.163007:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161280 00000100:00100000:0.0:1775764865.163009:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161280 00000100:00100000:0.0:1775764865.163039:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160896 00000100:00100000:0.0:1775764865.163042:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160896 00000100:00100000:0.0:1775764865.163067:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161408 00000100:00100000:0.0:1775764865.163070:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161408 00000100:00100000:0.0:1775764865.163085:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1464 00000100:00100000:0.0:1775764865.163090:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076160768:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.163117:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076160768:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.163125:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1464 00000100:00100000:0.0:1775764865.163136:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1465 00000100:00100000:0.0:1775764865.163149:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076161280:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.163173:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076161280:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.163179:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1465 00000100:00100000:0.0:1775764865.163190:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1466 00000100:00100000:0.0:1775764865.163196:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076160896:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.163217:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2409:x1862023076160896:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.163223:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1466 00000100:00100000:0.0:1775764865.163234:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1467 00000100:00100000:0.0:1775764865.163239:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2409:x1862023076161408:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.163259:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2409:x1862023076161408:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 20us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.163265:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1467 00000100:00100000:0.0:1775764865.163283:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076160384 00000100:00100000:0.0:1775764865.163286:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076160384 00000100:00100000:0.0:1775764865.163311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 985 00000100:00100000:0.0:1775764865.163317:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076160384:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764865.163337:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2409:x1862023076160384:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.163344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 985 00000100:00080000:0.0:1775764865.163377:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764865.163381:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1775764865.163383:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764865.163391:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1775764865.202627:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764865.202641:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764865.202667:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 157 count 5 00000040:00080000:3.0:1775764865.202674:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764865.330463:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099841664:0@lo:400:kworker.0 00000100:00100000:3.0:1775764865.330544:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764865.330744:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841664 00000100:00100000:0.0:1775764865.330753:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841664 00000100:00100000:0.0:1775764865.330834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1775764865.330843:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099841664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764865.331560:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099842048:0@lo:400:kworker.0 00000100:00100000:1.0:1775764865.331599:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764865.331641:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842048 00000100:00100000:1.0:1775764865.331646:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842048 00000100:00100000:1.0:1775764865.331677:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:1.0:1775764865.331683:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099842048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764865.331723:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099842048:12345-0@lo:400:kworker.0 Request processed in 39us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764865.331730:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:1.0:1775764865.331798:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099842048:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.332221:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099841664:12345-0@lo:400:kworker.0 Request processed in 1377us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.332229:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1775764865.332333:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099841664:0@lo:400:kworker.0 00000100:00100000:3.0:1775764865.332359:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099841792:0@lo:400:kworker.0 00000100:00100000:3.0:1775764865.332390:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764865.332458:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764865.332465:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099841920:0@lo:400:kworker.0 00000100:00100000:3.0:1775764865.332489:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764865.333235:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841920 00000100:00100000:1.0:1775764865.333243:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841920 00000100:00100000:1.0:1775764865.333388:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1775764865.333396:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099841920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764865.333455:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099841920:12345-0@lo:400:kworker.0 Request processed in 59us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764865.333462:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1775764865.334203:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099841792 00000100:00100000:0.0:1775764865.334211:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099841792 00000100:00100000:0.0:1775764865.334286:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:0.0:1775764865.334294:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099841792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.334340:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099841792:12345-0@lo:400:kworker.0 Request processed in 48us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.334347:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1775764865.335488:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099842432:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.335534:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764865.335558:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099842944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.335574:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764865.335638:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1775764865.335644:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099842304:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.335665:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764865.335679:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099842816:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.335697:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764865.335722:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842432 00000100:00100000:2.0:1775764865.335728:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842432 00000100:00100000:2.0:1775764865.335816:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842944 00000100:00100000:2.0:1775764865.335820:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842944 00000100:00100000:2.0:1775764865.335841:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842304 00000100:00100000:2.0:1775764865.335843:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842304 00000100:00100000:2.0:1775764865.335858:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842816 00000100:00100000:2.0:1775764865.335860:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842816 00000100:00100000:2.0:1775764865.335873:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1775764865.335880:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099842432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.335920:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099842432:12345-0@lo:400:kworker.0 Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764865.335927:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1775764865.335943:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1775764865.335948:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099842944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.335970:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099842944:12345-0@lo:400:kworker.0 Request processed in 22us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764865.335976:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1775764865.335986:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1775764865.335991:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099842304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.336011:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099842304:12345-0@lo:400:kworker.0 Request processed in 20us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764865.336038:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1775764865.336050:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1775764865.336056:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099842816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.336081:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099842816:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764865.336087:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1775764865.336266:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099842304:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.336276:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099842816:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.336284:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099842432:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.336292:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099842944:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.337543:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c420d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099842176:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.337602:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764865.337631:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099842688:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.337650:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764865.337667:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099843200:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.337686:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764865.337739:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1775764865.337746:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099842560:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.337784:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764865.337811:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099843072:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.337833:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1775764865.337902:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1775764865.337908:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764865.337927:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842688 00000100:00100000:0.0:1775764865.337934:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842688 00000100:00100000:0.0:1775764865.337975:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843200 00000100:00100000:0.0:1775764865.337977:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843200 00000100:00100000:0.0:1775764865.337994:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842560 00000100:00100000:0.0:1775764865.337996:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842560 00000100:00100000:0.0:1775764865.338008:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843072 00000100:00100000:0.0:1775764865.338010:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843072 00000100:00100000:0.0:1775764865.338037:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1775764865.338045:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099842688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338107:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099842688:12345-0@lo:400:kworker.0 Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.338113:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1775764865.338128:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1775764865.338134:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099843200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338160:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099843200:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.338166:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1775764865.338175:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1775764865.338181:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099842560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338204:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099842560:12345-0@lo:400:kworker.0 Request processed in 23us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.338209:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1775764865.338219:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1775764865.338224:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099843072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338267:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099843072:12345-0@lo:400:kworker.0 Request processed in 42us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.338279:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00080000:0.0:1775764865.338305:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764865.338308:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764865.338347:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099842560:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338356:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099843072:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338364:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c739bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099842688:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.338372:0:3664:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967731 gen 2 00000004:00080000:0.0:1775764865.338376:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c1c3771500, transno 4294967731 00000100:00100000:0.0:1775764865.338387:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099843200:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.339196:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099842176 00000100:00100000:2.0:1775764865.339205:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099842176 00000100:00100000:2.0:1775764865.339245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1775764865.339252:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099842176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.339309:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099842176:12345-0@lo:400:kworker.0 Request processed in 58us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764865.339315:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1775764865.339349:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099842176:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.340678:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c420e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099841920:0@lo:400:kworker.0 00000100:00100000:2.0:1775764865.340696:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c35dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099841792:0@lo:400:kworker.0 00000100:00100000:0.0:1775764865.845254:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1775764865.845276:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099843328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764865.845343:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764865.845415:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843328 00000100:00100000:0.0:1775764865.845421:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843328 00000100:00100000:0.0:1775764865.845462:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1775764865.845469:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099843328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1775764865.845495:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:0.0:1775764865.845531:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099843328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764865.845537:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1775764865.845574:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099843328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1775764865.848185:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1775764865.848210:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099843456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764865.848275:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764865.848367:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843456 00000100:00100000:3.0:1775764865.848375:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843456 00000100:00100000:3.0:1775764865.848419:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1775764865.848427:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099843456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1775764865.848450:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:3.0:1775764865.848493:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099843456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764865.848499:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1775764865.848543:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099843456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1775764865.912633:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764866.935237:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764867.898053:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099843584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1775764867.898140:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764867.898410:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843584 00000100:00100000:0.0:1775764867.898418:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843584 00000100:00100000:0.0:1775764867.898471:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1775764867.898480:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099843584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1775764867.898519:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:0.0:1775764867.898566:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099843584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764867.898573:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1775764867.900559:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099843584:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1775764867.956587:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764868.914419:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099843712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1775764868.914512:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764868.914609:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843712 00000100:00100000:0.0:1775764868.914619:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843712 00000100:00100000:0.0:1775764868.914691:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1775764868.914709:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099843712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1775764868.914742:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00080000:3.0:1775764868.915029:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764868.917657:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099843712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2937us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764868.917915:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1775764868.918047:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099843712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764868.918241:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099843840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764868.918328:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764868.918493:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843840 00000100:00100000:0.0:1775764868.918500:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843840 00000100:00100000:0.0:1775764868.918563:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1775764868.918571:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099843840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764868.918593:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00080000:1.0:1775764868.918654:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764868.919257:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099843840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 685us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764868.919266:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1775764868.919465:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099843840:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1775764868.984131:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764868.984140:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764868.984667:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764868.984677:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1775764868.985462:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764869.938358:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099843968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764869.938430:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764869.942532:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099843968 00000100:00100000:1.0:1775764869.942548:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099843968 00000100:00100000:1.0:1775764869.942617:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:1.0:1775764869.942627:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099843968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764869.942959:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1775764869.943060:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099843968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 434us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764869.943068:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:1.0:1775764869.943392:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099843968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1775764870.003824:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764870.284309:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284390:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284435:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284458:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284478:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284498:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284516:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284534:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284603:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764870.284635:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161792 00000100:00100000:1.0:1775764870.284646:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161792 00000100:00100000:1.0:1775764870.284718:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162304 00000100:00100000:1.0:1775764870.284722:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162304 00000100:00100000:1.0:1775764870.284739:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161664 00000100:00100000:1.0:1775764870.284741:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161664 00000100:00100000:1.0:1775764870.284805:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162176 00000100:00100000:1.0:1775764870.284809:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162176 00000100:00100000:1.0:1775764870.284826:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2014 00000100:00100000:1.0:1775764870.284836:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f98c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076161792:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.284913:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f98c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076161792:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 78us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.284922:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2014 00000100:00100000:1.0:1775764870.284941:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2015 00000100:00100000:1.0:1775764870.284947:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076162304:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.284982:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076162304:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.284988:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2015 00000100:00100000:1.0:1775764870.285000:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2016 00000100:00100000:1.0:1775764870.285006:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076161664:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.285029:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+51:2411:x1862023076161664:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.285035:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2016 00000100:00100000:1.0:1775764870.285051:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2017 00000100:00100000:1.0:1775764870.285057:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:2411:x1862023076162176:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.285079:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:2411:x1862023076162176:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.285085:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2017 00000100:00100000:1.0:1775764870.285102:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162048 00000100:00100000:1.0:1775764870.285106:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162048 00000100:00100000:1.0:1775764870.285154:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162560 00000100:00100000:1.0:1775764870.285158:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162560 00000100:00100000:1.0:1775764870.285174:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161920 00000100:00100000:1.0:1775764870.285177:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161920 00000100:00100000:1.0:1775764870.285187:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162432 00000100:00100000:1.0:1775764870.285189:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162432 00000100:00100000:1.0:1775764870.285201:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1472 00000100:00100000:1.0:1775764870.285206:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076162048:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.285232:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076162048:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.285238:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1472 00000100:00100000:1.0:1775764870.285249:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1473 00000100:00100000:1.0:1775764870.285255:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2ff821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076162560:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.285273:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2ff821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076162560:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 19us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.285279:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1473 00000100:00100000:1.0:1775764870.285288:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1474 00000100:00100000:1.0:1775764870.285294:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076161920:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.285337:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076161920:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 42us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.285343:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1474 00000100:00100000:1.0:1775764870.285353:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1475 00000100:00100000:1.0:1775764870.285358:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076162432:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764870.285391:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076162432:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 33us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764870.285406:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1475 00000100:00080000:1.0:1775764870.285443:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1775764870.285447:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764870.285449:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1775764870.285451:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764870.285850:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076161536 00000100:00100000:3.0:1775764870.285855:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076161536 00000100:00100000:3.0:1775764870.285893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 987 00000100:00100000:3.0:1775764870.285900:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076161536:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764870.285946:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076161536:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 46us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.285952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 987 00000100:00100000:3.0:1775764870.452078:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099844224:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452154:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452207:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099844736:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452228:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452243:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099845248:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452261:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452304:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1775764870.452309:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099844096:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452336:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452357:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099844608:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452379:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452396:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099845120:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452416:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452432:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099845632:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452448:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452487:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099844352:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452508:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452523:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099844864:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452538:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452551:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099845376:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452566:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452584:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1775764870.452589:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099844480:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452608:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452624:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099844992:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452641:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452656:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099845504:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452674:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.452719:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844224 00000100:00100000:3.0:1775764870.452727:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844224 00000100:00100000:3.0:1775764870.452767:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844736 00000100:00100000:3.0:1775764870.452800:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844736 00000100:00100000:3.0:1775764870.452826:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845248 00000100:00100000:3.0:1775764870.452828:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845248 00000100:00100000:3.0:1775764870.452839:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844864 00000100:00100000:3.0:1775764870.452841:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844864 00000100:00100000:3.0:1775764870.452851:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845376 00000100:00100000:3.0:1775764870.452853:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845376 00000100:00100000:3.0:1775764870.452863:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844480 00000100:00100000:3.0:1775764870.452865:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844480 00000100:00100000:3.0:1775764870.452877:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1775764870.452885:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099844224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.452941:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099844224:12345-0@lo:400:kworker.0 Request processed in 57us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.452954:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1775764870.452982:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:3.0:1775764870.452988:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099844736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453019:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099844736:12345-0@lo:400:kworker.0 Request processed in 32us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453024:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:3.0:1775764870.453036:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:3.0:1775764870.453041:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099845248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453065:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099845248:12345-0@lo:400:kworker.0 Request processed in 25us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453071:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:3.0:1775764870.453082:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1775764870.453086:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099844864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453116:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099844864:12345-0@lo:400:kworker.0 Request processed in 29us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453121:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1775764870.453132:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1775764870.453137:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099845376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453163:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099845376:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453168:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1775764870.453179:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1775764870.453185:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099844480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453209:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099844480:12345-0@lo:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453222:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1775764870.453252:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844096 00000100:00100000:3.0:1775764870.453257:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844096 00000100:00100000:3.0:1775764870.453282:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1775764870.453287:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099844096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453316:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099844096:12345-0@lo:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1775764870.453346:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844608 00000100:00100000:3.0:1775764870.453349:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844608 00000100:00100000:3.0:1775764870.453371:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844352 00000100:00100000:3.0:1775764870.453374:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844352 00000100:00100000:3.0:1775764870.453386:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1775764870.453391:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099844608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453422:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099844608:12345-0@lo:400:kworker.0 Request processed in 31us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1775764870.453439:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1775764870.453445:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099844352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453472:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099844352:12345-0@lo:400:kworker.0 Request processed in 27us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1775764870.453495:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845120 00000100:00100000:3.0:1775764870.453498:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845120 00000100:00100000:3.0:1775764870.453521:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845632 00000100:00100000:3.0:1775764870.453524:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845632 00000100:00100000:3.0:1775764870.453540:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099844992 00000100:00100000:3.0:1775764870.453548:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099844992 00000100:00100000:3.0:1775764870.453565:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845504 00000100:00100000:3.0:1775764870.453567:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845504 00000100:00100000:3.0:1775764870.453580:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1775764870.453585:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099845120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453613:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099845120:12345-0@lo:400:kworker.0 Request processed in 28us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453620:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1775764870.453629:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1775764870.453635:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099845632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453659:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099845632:12345-0@lo:400:kworker.0 Request processed in 25us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453665:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1775764870.453676:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1775764870.453681:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099844992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453705:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099844992:12345-0@lo:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453710:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1775764870.453719:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1775764870.453724:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099845504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453748:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099845504:12345-0@lo:400:kworker.0 Request processed in 24us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764870.453754:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00080000:3.0:1775764870.453819:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764870.453824:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764870.453826:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764870.453828:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764870.453882:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099844096:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453898:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099844608:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453909:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099845120:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453919:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099845632:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453928:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099844224:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453937:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099844736:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.453947:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099845248:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.454004:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099844480:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.454013:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099844992:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.454020:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099845504:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.454029:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099844352:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.454038:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099844864:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.454046:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099845376:0@lo:400:kworker.0 00000100:00100000:3.0:1775764870.962604:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099845760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1775764870.962681:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764870.962972:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099845888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764870.963000:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764870.963301:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845760 00000100:00100000:2.0:1775764870.963311:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845760 00000100:00100000:2.0:1775764870.963359:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099845888 00000100:00100000:2.0:1775764870.963363:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099845888 00000100:00100000:2.0:1775764870.963384:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1775764870.963394:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099845760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764870.963432:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:2.0:1775764870.963500:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099845760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764870.963507:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1775764870.963525:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1775764870.963531:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099845888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764870.963542:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:2.0:1775764870.963567:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099845888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764870.963572:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1775764870.963648:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099845760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1775764870.963989:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099845888:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1775764871.039043:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764871.377798:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764871.378042:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162688 00000100:00100000:2.0:1775764871.378052:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162688 00000100:00100000:2.0:1775764871.378112:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6647 00000100:00100000:2.0:1775764871.378122:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+51:49521:x1862023076162688:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1775764871.379045:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+51:49521:x1862023076162688:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 135us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764871.379059:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6647 00000100:00100000:3.0:1775764871.390044:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764871.390144:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076162816 00000100:00100000:0.0:1775764871.390158:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076162816 00000100:00100000:0.0:1775764871.390224:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6648 00000100:00100000:0.0:1775764871.390245:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:49521:x1862023076162816:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764871.390361:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:49521:x1862023076162816:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 118us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764871.390368:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6648 00010000:00010000:2.0:1775764872.052119:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764873.010622:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775764873.010650:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099846016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764873.010731:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764873.011069:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099846016 00000100:00100000:2.0:1775764873.011078:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099846016 00000100:00100000:2.0:1775764873.011141:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1775764873.011151:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c67adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099846016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1775764873.011190:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444216832 avail 1297977344 00000100:00100000:2.0:1775764873.011236:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c67adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099846016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764873.011255:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1775764873.011572:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099846016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1775764873.073919:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775764873.197173:0:32550:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 26b: RAoLU policy when CDT off ======== 16:01:11 (1775764871) 00000100:00100000:3.0:1775764873.652548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.652746:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163072 00000100:00100000:1.0:1775764873.652811:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163072 00000100:00100000:0.0:1775764873.652915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6649 00000100:00100000:0.0:1775764873.652928:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+51:50379:x1862023076163072:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764873.652962:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764873.653000:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5241ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5674 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653073:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653088:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653104:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653118:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653125:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653151:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653252:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed5241cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653261:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed5241cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653269:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed5241cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764873.653278:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1775764873.653367:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653375:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653381:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653387:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653393:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2d800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764873.653397:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653404:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1775764873.653415:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1775764873.653426:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:0.0:1775764873.653429:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764873.653435:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653441:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d800/0x6e98bd47ed5241c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653453:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653458:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653463:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653468:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2da00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764873.653470:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653475:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653483:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c2c894cb00) 00010000:00010000:0.0:1775764873.653485:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764873.653488:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.653494:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2da00/0x6e98bd47ed5241c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764873.671078:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.671269:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163200 00000100:00100000:1.0:1775764873.671291:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163200 00000100:00100000:1.0:1775764873.671383:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6650 00000100:00100000:1.0:1775764873.671395:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:50380:x1862023076163200:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764873.671420:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764873.671445:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed5241dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd567b expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671571:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671587:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671600:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671613:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671639:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671646:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671709:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671716:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671722:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671729:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403e400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.671733:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671740:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.671752:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764873.672018:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.672026:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672032:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed5241e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672047:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672061:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672067:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672072:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403ec00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.672076:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672082:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672091:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x716374db (ffff96c2c7e0f400) 00010000:00010000:1.0:1775764873.672094:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.672097:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672103:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed5241eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672140:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed5241dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd567b expref: 42 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672150:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764873.672153:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.672156:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed5241dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd567b expref: 42 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.672176:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403e000, rc 0) 00000100:00100000:1.0:1775764873.672253:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:50380:x1862023076163200:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 861us (1188us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764873.672261:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6650 00000100:00080000:3.0:1775764873.672495:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764873.677016:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764873.678668:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163456 00000100:00100000:2.0:1775764873.678684:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163456 00000100:00100000:2.0:1775764873.678760:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6651 00000100:00100000:2.0:1775764873.678799:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+41:50380:x1862023076163456:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:2.0:1775764873.678870:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764873.678896:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0a00/0x6e98bd47ed523d61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54bb expref: 41 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.678917:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764873.678923:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1775764873.678993:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.679006:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 53 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.679033:0:14288:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.679062:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 53 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.679075:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 53 pid: 10088 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764873.679089:0:14288:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099846144:192.168.202.58@tcp:104: 00000100:00100000:2.0:1775764873.679184:0:14288:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d8838600 going to sleep for 11 seconds 00000100:00100000:2.0:1775764873.682895:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.683016:0:14288:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14288:1862023099846144:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764873.683045:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764873.683140:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163584 00000100:00100000:1.0:1775764873.683148:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163584 00010000:00010000:1.0:1775764873.683184:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 54 pid: 10088 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764873.683216:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1440 00000100:00100000:1.0:1775764873.683225:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+54:2411:x1862023076163584:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764873.683252:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764873.683259:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 54 pid: 10088 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.683272:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 54 pid: 10088 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.683306:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8d9200/0x6e98bd47ed523da0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd54d0 expref: 54 pid: 10088 timeout: 1481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.683323:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764873.683329:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.683338:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.683359:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.683390:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764873.683446:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+53:2411:x1862023076163584:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 221us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764873.683455:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1440 00010000:00010000:2.0:1775764873.683986:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.683996:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684023:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x716374db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684034:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684042:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684623:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684638:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684645:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764873.684658:0:14288:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f8ce9828 reply state 00000000281bebba transno 4294970719 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684668:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684675:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:2.0:1775764873.684677:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764873.684681:0:14288:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1775764873.684686:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x18:0x0]: returning size 4096 00010000:00010000:2.0:1775764873.684692:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684697:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684702:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684707:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.684711:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684717:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684732:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764873.684734:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.684738:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684743:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2c00/0x6e98bd47ed5241f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1775764873.684754:0:14288:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f8ce9828 reply state 00000000281bebba transno 4294970719 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684760:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.684764:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x716374db (ffff96c1c7207800) 00010000:00010000:2.0:1775764873.684766:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1775764873.684768:0:14288:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1775764873.684863:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:50380:x1862023076163456:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 6093us (7857us total) trans 4294970719 rc 0/0 00000100:00100000:2.0:1775764873.684872:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6651 00000100:00100000:2.0:1775764873.697920:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.698123:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163712 00000100:00100000:3.0:1775764873.698137:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163712 00000100:00100000:3.0:1775764873.698264:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6652 00000100:00100000:3.0:1775764873.698276:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:50381:x1862023076163712:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:3.0:1775764873.698314:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.698337:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed524207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5682 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.698410:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52420e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.698426:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52420e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.698440:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52420e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764873.698492:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1775764873.698508:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764873.698532:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52420e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.698556:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6c400/0x6e98bd47ed524207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5682 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.698572:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52420e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5682 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.698581:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764873.698584:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764873.698587:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d200, rc 0) 00000100:00100000:3.0:1775764873.698656:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:50381:x1862023076163712:12345-192.168.202.58@tcp:101:bash.0 Request processed in 382us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.698664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6652 00000100:00100000:3.0:1775764873.703092:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764873.703167:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163840 00000100:00100000:2.0:1775764873.703179:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163840 00000100:00100000:2.0:1775764873.703251:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6653 00000100:00100000:2.0:1775764873.703261:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:50381:x1862023076163840:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:2.0:1775764873.703294:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764873.703317:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5689 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703411:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703427:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703440:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703452:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703459:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703465:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703543:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed52422a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703551:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed52422a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703556:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed52422a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764873.703585:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x18:0x0]: returning size 4096 00000004:00200000:2.0:1775764873.703589:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764873.703609:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed52422a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703631:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703637:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703642:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703648:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703653:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.703657:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703664:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703675:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764873.703678:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.703682:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703687:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2800/0x6e98bd47ed52421c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703700:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703704:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703713:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703718:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.703720:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703725:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703731:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x716374db (ffff96c1c7207800) 00010000:00010000:2.0:1775764873.703733:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.703735:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703740:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed524223 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703763:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5689 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703811:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3000/0x6e98bd47ed52422a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5689 expref: 44 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.703818:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:2.0:1775764873.703820:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764873.703822:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3000, rc 0) 00000100:00100000:2.0:1775764873.703884:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:50381:x1862023076163840:12345-192.168.202.58@tcp:101:bash.0 Request processed in 625us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764873.703900:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6653 00000100:00100000:2.0:1775764873.707806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.707904:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076163968 00000100:00100000:3.0:1775764873.707914:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076163968 00000100:00100000:3.0:1775764873.707979:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6654 00000100:00100000:3.0:1775764873.707989:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:50381:x1862023076163968:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:3.0:1775764873.708010:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.708032:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed524231 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5690 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708144:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708162:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708169:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708175:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708224:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708230:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708246:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708252:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708258:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c3f6d000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764873.708261:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708268:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708287:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.708297:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.708303:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708309:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d000/0x6e98bd47ed524238 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708324:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708330:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708335:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708340:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764873.708342:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708348:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708355:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c1c2a03300) 00010000:00010000:3.0:1775764873.708357:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.708359:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708364:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1800/0x6e98bd47ed52423f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708394:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed524231 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5690 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708410:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.708412:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.708416:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d400/0x6e98bd47ed524231 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5690 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.708424:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c3f6d400, rc 0) 00000100:00100000:3.0:1775764873.708495:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c35dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:50381:x1862023076163968:12345-192.168.202.58@tcp:101:bash.0 Request processed in 507us (724us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764873.708502:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6654 00000100:00100000:3.0:1775764873.721796:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.721920:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164096 00000100:00100000:1.0:1775764873.721931:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164096 00000100:00100000:1.0:1775764873.721998:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6655 00000100:00100000:1.0:1775764873.722008:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+53:50382:x1862023076164096:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764873.722029:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764873.722053:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5697 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.722181:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.722196:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.722210:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764873.722271:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764873.722275:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764873.722319:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.722364:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.722382:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.722390:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764873.722392:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764873.722396:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403f600, rc 0) 00000100:00100000:1.0:1775764873.722458:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:50382:x1862023076164096:12345-192.168.202.58@tcp:101:rm.0 Request processed in 451us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764873.722465:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6655 00000100:00100000:1.0:1775764873.726064:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764873.726137:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164224 00000100:00100000:2.0:1775764873.726147:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164224 00000100:00100000:2.0:1775764873.726210:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6656 00000100:00100000:2.0:1775764873.726220:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+54:50382:x1862023076164224:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764873.726256:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764873.726288:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2200/0x6e98bd47ed524254 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd569e expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726368:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726386:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726399:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726412:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726418:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726424:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726511:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524269 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726539:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524269 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726546:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524269 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764873.726581:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x18:0x0]: returning size 4096 00000004:00200000:2.0:1775764873.726585:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764873.726605:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524269 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726617:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726624:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726630:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726636:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726641:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.726646:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726652:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726665:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764873.726674:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.726680:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726686:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52425b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726701:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726706:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726711:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726716:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.726718:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726724:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726731:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x716374db (ffff96c1c7207800) 00010000:00010000:2.0:1775764873.726734:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.726736:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726741:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524262 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726766:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2200/0x6e98bd47ed524254 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd569e expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726851:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3600/0x6e98bd47ed524269 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd569e expref: 55 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.726859:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:2.0:1775764873.726861:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764873.726863:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3600, rc 0) 00000100:00100000:2.0:1775764873.726925:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:50382:x1862023076164224:12345-192.168.202.58@tcp:101:rm.0 Request processed in 706us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764873.726934:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6656 00000100:00100000:1.0:1775764873.735505:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.735584:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164352 00000100:00100000:3.0:1775764873.735595:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164352 00000100:00100000:3.0:1775764873.735669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6657 00000100:00100000:3.0:1775764873.735680:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:50382:x1862023076164352:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764873.735704:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.735725:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524270 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735827:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735854:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735890:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735898:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735904:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735950:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735958:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735963:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735969:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735974:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba0400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764873.735979:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735986:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.735998:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.736001:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.736006:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736019:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba0400/0x6e98bd47ed524277 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736034:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736040:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736046:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736052:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1ba1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764873.736055:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736061:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736068:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c1c2a03d00) 00010000:00010000:3.0:1775764873.736071:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.736074:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736079:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1000/0x6e98bd47ed52427e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736113:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524270 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56a5 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736134:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.736136:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.736140:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1ba1600/0x6e98bd47ed524270 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56a5 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.736149:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1ba1600, rc 0) 00000100:00100000:3.0:1775764873.736211:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:50382:x1862023076164352:12345-192.168.202.58@tcp:101:rm.0 Request processed in 532us (715us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764873.736219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6657 00000100:00100000:3.0:1775764873.740160:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.740234:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164480 00000100:00100000:1.0:1775764873.740244:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164480 00000100:00100000:1.0:1775764873.740310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6658 00000100:00100000:1.0:1775764873.740320:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:50382:x1862023076164480:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764873.740341:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764873.740361:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed524285 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56ac expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740495:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740511:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740542:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740558:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740565:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740571:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740616:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740624:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740631:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740637:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740644:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403e600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.740661:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740669:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740681:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764873.740690:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.740695:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740702:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52428c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740717:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740722:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740728:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740734:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.740736:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740742:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740750:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c2c7e0f900) 00010000:00010000:1.0:1775764873.740753:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.740756:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740810:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524293 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740847:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed524285 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56ac expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740864:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764873.740867:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.740870:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed524285 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56ac expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.740879:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403ea00, rc 0) 00000100:00100000:1.0:1775764873.740956:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:50382:x1862023076164480:12345-192.168.202.58@tcp:101:rm.0 Request processed in 637us (806us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764873.740963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6658 00000100:00100000:1.0:1775764873.763910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764873.764107:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164608 00000100:00100000:2.0:1775764873.764118:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164608 00000100:00100000:2.0:1775764873.764180:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6659 00000100:00100000:2.0:1775764873.764189:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:50383:x1862023076164608:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:2.0:1775764873.764211:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764873.764243:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed52429a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56b3 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764514:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764531:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764542:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764556:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764578:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764585:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764625:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764633:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764640:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764646:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764664:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cec00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.764669:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764677:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764690:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:2.0:1775764873.764694:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.764698:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764706:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5242a1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764727:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764733:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764739:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764744:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cfc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764873.764747:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764752:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764984:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c1c7207200) 00010000:00010000:2.0:1775764873.764986:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.764990:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.764996:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed5242a8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.765036:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed52429a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56b3 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.765047:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:2.0:1775764873.765049:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764873.765059:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed52429a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56b3 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764873.765071:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e2a00, rc 0) 00000100:00100000:2.0:1775764873.765149:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:50383:x1862023076164608:12345-192.168.202.58@tcp:101:cp.0 Request processed in 960us (1246us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764873.765157:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6659 00000100:00100000:2.0:1775764873.770745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.770924:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164736 00000100:00100000:3.0:1775764873.770965:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164736 00000100:00100000:3.0:1775764873.771032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6660 00000100:00100000:3.0:1775764873.771043:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:50383:x1862023076164736:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764873.771065:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.771088:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed5242af lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771160:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771178:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771190:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771227:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771246:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771253:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771306:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771314:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771319:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771326:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771331:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764873.771336:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771344:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771357:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.771361:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.771366:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771501:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed5242b6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771516:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771521:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771526:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771530:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764873.771532:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771537:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771544:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c1c2a03700) 00010000:00010000:3.0:1775764873.771547:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.771549:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771554:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed5242bd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771586:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed5242af lrc: 1/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56ba expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771605:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.771607:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764873.771610:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed5242af lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56ba expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.771619:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0000, rc 0) 00000100:00100000:3.0:1775764873.771682:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:50383:x1862023076164736:12345-192.168.202.58@tcp:101:cp.0 Request processed in 642us (948us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764873.771691:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6660 00000100:00100000:3.0:1775764873.775839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.775930:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076164992 00000100:00100000:1.0:1775764873.775952:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076164992 00000100:00100000:1.0:1775764873.776011:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6661 00000100:00100000:1.0:1775764873.776021:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:50383:x1862023076164992:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:1.0:1775764873.776045:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764873.776066:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed5242c4 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56c1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776173:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776188:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776199:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776241:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776248:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776254:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764873.776567:0:6522:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x58:0x0], index 0: 0 00010000:00010000:1.0:1775764873.776727:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776735:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776740:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776810:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776816:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776822:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776829:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776834:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403fe00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.776845:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776852:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776865:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764873.776868:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.776872:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 3/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776878:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242cb lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764873.776891:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d96a2012 reply state 000000001745c2ab transno 4294970720 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776900:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776905:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764873.776907:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764873.776910:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764873.776948:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed5242c4 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776962:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.776968:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764873.776971:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764873.776978:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403f000, rc 0) 00000100:00100000:1.0:1775764873.777043:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+58:50383:x1862023076164992:12345-192.168.202.58@tcp:101:cp.0 Request processed in 1023us (1213us total) trans 4294970720 rc 0/0 00000100:00100000:1.0:1775764873.777052:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6661 00000100:00100000:1.0:1775764873.782067:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.782146:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076165120 00000100:00100000:3.0:1775764873.782158:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076165120 00000100:00100000:3.0:1775764873.782242:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1761 00000100:00100000:3.0:1775764873.782253:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076165120:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764873.782271:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.782342:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56c8 expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764873.782370:0:8641:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1775764873.782389:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764873.782391:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764873.782398:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.782414:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 7 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.782445:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1e00, rc 0) 00000100:00100000:3.0:1775764873.782493:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076165120:12345-192.168.202.58@tcp:101:cp.0 Request processed in 243us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.782499:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1761 00000100:00080000:1.0:1775764873.782696:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764873.789045:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.789174:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076165248 00000100:00100000:3.0:1775764873.789188:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076165248 00000100:00100000:3.0:1775764873.789261:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1762 00000100:00100000:3.0:1775764873.789271:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:50383:x1862023076165248:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764873.789289:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.789307:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56cf expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.789338:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.789347:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764873.789349:0:8403:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764873.789354:0:8403:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.789386:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.789400:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 1481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764873.789434:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099846272:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764873.789525:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b2a000 going to sleep for 11 seconds 00000100:00100000:1.0:1775764873.791715:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1862023099846272:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764873.791750:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.791810:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc 0) 00000100:00100000:1.0:1775764873.791870:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:50383:x1862023076165248:12345-192.168.202.58@tcp:101:cp.0 Request processed in 2600us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764873.791880:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1762 00000100:00100000:2.0:1775764873.797684:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.797747:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076165376 00000100:00100000:3.0:1775764873.797757:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076165376 00010000:00010000:3.0:1775764873.797819:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 1481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764873.797850:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1441 00000100:00100000:3.0:1775764873.797857:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076165376:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764873.797871:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764873.797892:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 1481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.797903:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 1481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.797923:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed5242e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c8 expref: 8 pid: 8641 timeout: 1481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.797950:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764873.797952:0:6506:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764873.797960:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.797989:0:6506:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.798027:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764873.798043:0:6506:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1862023099846400:192.168.202.58@tcp:105: 00000100:00100000:3.0:1775764873.798139:0:6506:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1775764873.801972:0:6506:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1862023099846400:192.168.202.58@tcp:105: 00010000:00010000:3.0:1775764873.801998:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764873.802068:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076165376:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 4209us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.802079:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1441 00000100:00100000:1.0:1775764873.812228:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.812354:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076165632 00000100:00100000:3.0:1775764873.812367:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076165632 00000100:00100000:3.0:1775764873.812430:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1387 00000100:00100000:3.0:1775764873.812442:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+58:50383:x1862023076165632:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:3.0:1775764873.812850:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:50383:x1862023076165632:12345-192.168.202.58@tcp:35:cp.0 Request processed in 409us (631us total) trans 4294970721 rc 0/0 00000100:00100000:3.0:1775764873.812857:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1387 00010000:00010000:0.0:1775764873.845337:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5241ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5674 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.845369:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed5241cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5674 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764873.845379:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764873.845382:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764873.845387:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2de00, rc 0) 00000100:00100000:0.0:1775764873.845464:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+58:50379:x1862023076163072:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 192538us (192924us total) trans 4294970718 rc 0/0 00000100:00100000:0.0:1775764873.845475:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6649 00000100:00100000:1.0:1775764873.850495:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.850542:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.850620:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166016 00000100:00100000:3.0:1775764873.850633:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166016 00000100:00100000:3.0:1775764873.850719:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 761 00000100:00100000:3.0:1775764873.850731:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+58:2408:x1862023076166016:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764873.850767:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764873.850839:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed5241cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5674 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.850858:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764873.850864:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764873.850924:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+57:2408:x1862023076166016:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 195us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.850932:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 761 00000100:00100000:2.0:1775764873.851006:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076165888 00000100:00100000:2.0:1775764873.851011:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076165888 00000100:00100000:2.0:1775764873.851081:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1388 00000100:00100000:2.0:1775764873.851088:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+57:50379:x1862023076165888:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1775764873.851291:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+58:50379:x1862023076165888:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 203us (807us total) trans 4294970722 rc 0/0 00000100:00100000:2.0:1775764873.851298:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1388 00000100:00100000:2.0:1775764873.854886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.854980:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166144 00000100:00100000:3.0:1775764873.854994:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166144 00000100:00100000:3.0:1775764873.855061:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6662 00000100:00100000:3.0:1775764873.855071:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c420fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+58:50379:x1862023076166144:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1775764873.855184:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c420fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+58:50379:x1862023076166144:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.855191:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6662 00000100:00100000:1.0:1775764873.866085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.866320:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166272 00000100:00100000:3.0:1775764873.866331:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166272 00000100:00100000:3.0:1775764873.866407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6663 00000100:00100000:3.0:1775764873.866417:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2c8960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:50379:x1862023076166272:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1775764873.866536:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2c8960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:50379:x1862023076166272:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 120us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.866544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6663 00000100:00080000:1.0:1775764873.866658:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764873.888036:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764873.888157:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166400 00000100:00100000:1.0:1775764873.888170:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166400 00000100:00100000:1.0:1775764873.888246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6664 00000100:00100000:1.0:1775764873.888256:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:50386:x1862023076166400:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764873.888279:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764873.888299:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242f5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56d6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888389:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888409:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888425:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888438:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888445:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888452:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888532:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888540:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888547:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764873.888591:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa2:0x0]: returning size 1516 00000004:00200000:1.0:1775764873.888596:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764873.888617:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888643:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888666:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888672:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888678:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888685:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888692:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403ea00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.888697:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888704:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888717:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764873.888720:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.888727:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 3/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888733:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed5242fc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888750:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888814:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888820:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888825:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764873.888828:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888834:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888842:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764873.888844:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764873.888847:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888853:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed524303 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888882:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5242f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56d6 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888897:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56d6 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764873.888907:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764873.888909:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764873.888917:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403e600, rc 0) 00000100:00100000:1.0:1775764873.888993:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c739bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:50386:x1862023076166400:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 738us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764873.889001:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6664 00000100:00100000:2.0:1775764873.904361:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.904500:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166528 00000100:00100000:3.0:1775764873.904510:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166528 00000100:00100000:3.0:1775764873.904599:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1763 00000100:00100000:3.0:1775764873.904609:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076166528:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764873.904628:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.904646:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed524311 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56dd expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764873.904715:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099846528:192.168.202.58@tcp:106: 00000100:00100000:3.0:1775764873.904838:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b2a000 going to sleep for 11 seconds 00000100:00080000:1.0:1775764873.905129:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1775764873.907396:0:24969:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb size: 0 -> 1516 00002000:00010000:3.0:1775764873.907406:0:24969:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb mtime: 0 -> 1775764873 00002000:00010000:3.0:1775764873.907409:0:24969:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb atime: 0 -> 1775764873 00002000:00010000:3.0:1775764873.907411:0:24969:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb ctime: 0 -> 1775764873 00002000:00010000:3.0:1775764873.907413:0:24969:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1775764873.907437:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24969:1862023099846528:192.168.202.58@tcp:106: 00010000:00010000:3.0:1775764873.907477:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed524311 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56dd expref: 9 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.907502:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000879e303b/0x6e98bd47ed524311 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56dd expref: 9 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.907517:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1e00, rc 0) 00000100:00100000:3.0:1775764873.907578:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076166528:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 2970us (3225us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764873.907587:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1763 00000100:00100000:0.0:1775764873.916885:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.917045:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166656 00000100:00100000:3.0:1775764873.917057:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166656 00000100:00100000:3.0:1775764873.917141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6665 00000100:00100000:3.0:1775764873.917151:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:50386:x1862023076166656:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764873.917186:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.917207:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56e4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.917484:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed52431f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.917501:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed52431f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.917513:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed52431f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764873.917554:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x18:0x0]: returning size 4096 00000004:00200000:3.0:1775764873.917558:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764873.917579:0:6523:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed52431f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.917605:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56e4 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.917623:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed52431f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56e4 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.917633:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:3.0:1775764873.917636:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1775764873.917639:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0000, rc 0) 00000100:00100000:3.0:1775764873.917703:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:50386:x1862023076166656:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 553us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764873.917717:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6665 00000100:00100000:1.0:1775764873.922285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764873.922414:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076166784 00000100:00100000:3.0:1775764873.922427:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076166784 00000100:00100000:3.0:1775764873.922494:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1764 00000100:00100000:3.0:1775764873.922505:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076166784:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:3.0:1775764873.922530:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764873.922551:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524326 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56eb expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764873.922617:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099846656:192.168.202.58@tcp:106: 00000100:00100000:3.0:1775764873.922721:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c1b2a000 going to sleep for 11 seconds 00000100:00100000:3.0:1775764873.928127:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8641:1862023099846656:192.168.202.58@tcp:106: 00010000:00010000:3.0:1775764873.928191:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524326 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56eb expref: 9 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.928218:0:8641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524326 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56eb expref: 9 pid: 8641 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764873.928242:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1800, rc 0) 00000100:00100000:3.0:1775764873.928309:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076166784:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 5805us (6037us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764873.928320:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1764 00000100:00100000:0.0:1775764873.934660:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764873.934844:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167040 00000100:00100000:2.0:1775764873.934857:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167040 00000100:00100000:2.0:1775764873.934927:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6666 00000100:00100000:2.0:1775764873.934948:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:50386:x1862023076167040:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:0.0:1775764873.935493:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].157, 136 off29336 00000100:00100000:0.0:1775764873.935591:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:50386:x1862023076167040:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 655us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764873.935600:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6666 00000100:00100000:0.0:1775764874.036847:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764874.036883:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099846784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764874.036986:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764874.038147:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1775764874.038167:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099846912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764874.038262:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764874.038429:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099846784 00000100:00100000:1.0:1775764874.038439:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099846784 00000100:00100000:1.0:1775764874.038507:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099846912 00000100:00100000:1.0:1775764874.038510:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099846912 00000100:00100000:1.0:1775764874.038531:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1775764874.038540:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099846784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1775764874.038574:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764874.038636:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099846784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764874.038644:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1775764874.038669:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1775764874.038676:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099846912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764874.038685:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42377408 pending 0 free 3916955648 avail 3685433344 00000100:00100000:1.0:1775764874.038712:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099846912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764874.038717:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1775764874.038763:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099846912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764874.039381:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099846784:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1775764874.040822:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1775764874.098704:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764874.098716:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764874.102095:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764874.102121:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1775764874.113567:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764874.419630:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764874.419638:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764874.419713:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 158 count 6 00000040:00080000:3.0:1775764874.419721:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764874.419972:0:13646:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099847040:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1775764874.420085:0:13646:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1775764874.422251:0:13646:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13646:1862023099847040:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1775764874.433603:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764874.433745:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167168 00000100:00100000:1.0:1775764874.433757:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167168 00000100:00100000:1.0:1775764874.433847:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6667 00000100:00100000:1.0:1775764874.433857:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+58:50396:x1862023076167168:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1775764874.433896:0:14288:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1775764874.434032:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+58:50396:x1862023076167168:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 175us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764874.434040:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6667 00000100:00100000:2.0:1775764874.441085:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764874.441279:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167424 00000100:00100000:3.0:1775764874.441290:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167424 00000100:00100000:3.0:1775764874.441344:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6668 00000100:00100000:3.0:1775764874.441353:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+58:50396:x1862023076167424:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1775764874.441375:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764874.441393:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed52432d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56f2 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.441500:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524334 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.441514:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524334 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.441528:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524334 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764874.441539:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa2:0x0]: returning size 1516 00010000:00010000:3.0:1775764874.441635:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed52432d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f2 expref: 61 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.441664:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524334 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f2 expref: 60 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.441673:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:3.0:1775764874.441676:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1775764874.441680:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c1e00, rc 0) 00000100:00100000:3.0:1775764874.441735:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076167424:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 383us (661us total) trans 4294970723 rc 0/0 00000100:00100000:3.0:1775764874.441742:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6668 00000100:00100000:2.0:1775764874.449868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764874.450140:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167552 00000100:00100000:3.0:1775764874.450152:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167552 00000100:00100000:3.0:1775764874.450215:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1765 00000100:00100000:3.0:1775764874.450235:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+7:2410:x1862023076167552:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1775764874.450280:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.450307:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.450316:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764874.450318:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1775764874.450321:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.450363:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.450385:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 7 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764874.450401:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099847168:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764874.450486:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2ff8f7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1775764874.453874:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764874.453913:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167680 00000100:00100000:2.0:1775764874.453921:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167680 00000100:00100000:2.0:1775764874.453991:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 762 00000100:00100000:2.0:1775764874.454000:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:2409:x1862023076167680:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764874.454017:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764874.454044:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1e00/0x6e98bd47ed524334 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f2 expref: 60 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.454063:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:2.0:1775764874.454068:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764874.454117:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+59:2409:x1862023076167680:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764874.454124:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 762 00000100:00100000:1.0:1775764874.457212:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099847168:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764874.457241:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764874.459214:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764874.463740:0:8409:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167808 00000100:00100000:1.0:1775764874.463758:0:8409:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167808 00002000:00100000:1.0:1775764874.463846:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x58:0x0] (0->1515) req@ffff96c1c4d91500 x1862023076167808/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:355/0 lens 2008/0 e 0 to 0 dl 1775764885 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764874.463857:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4d91500 with x1862023076167808 ext(0->1515) 00010000:00010000:1.0:1775764874.463868:0:8409:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 8 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764874.463886:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 8 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1775764874.463894:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c4d91500 00000100:00100000:1.0:1775764874.463921:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 37 00000100:00100000:1.0:1775764874.463940:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076167808:12345-192.168.202.58@tcp:4:cp.0 00000100:00100000:3.0:1775764874.472181:0:8409:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076167808:12345-192.168.202.58@tcp:4:cp.0 Request processed in 8242us (12961us total) trans 4294967731 rc 0/0 00000100:00100000:3.0:1775764874.472195:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 37 00002000:00100000:3.0:1775764874.472211:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x58:0x0] (0->1515) req@ffff96c1c4d91500 x1862023076167808/t4294967731(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:355/0 lens 2008/448 e 0 to 0 dl 1775764885 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1775764874.472221:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4d91500 with x1862023076167808 ext(0->1515) 00010000:00010000:3.0:1775764874.472232:0:8409:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 10 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.472250:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 10 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1775764874.472258:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96c1c4d91500 00000100:00100000:0.0:1775764874.477688:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764874.477798:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076167936 00000100:00100000:3.0:1775764874.477809:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076167936 00010000:00010000:3.0:1775764874.477861:0:24971:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 10 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764874.477903:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1442 00000100:00100000:3.0:1775764874.477923:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076167936:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764874.477955:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1775764874.477975:0:24971:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x58:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1775764874.477982:0:24971:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 10 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.477997:0:24971:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 10 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478023:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a30fa2eb/0x6e98bd47ed5242ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56cf expref: 10 pid: 8403 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478039:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764874.478042:0:24971:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764874.478047:0:24971:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478057:0:24971:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478087:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764874.478136:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076167936:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 216us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764874.478145:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1442 00010000:00010000:3.0:1775764874.478607:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478631:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478655:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478665:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478673:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478681:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:3.0:1775764874.478685:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478695:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478709:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.478716:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e511d9f/0x6e98bd47ed524342 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764874.478808:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076167552:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 28584us (28948us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764874.478830:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1765 00000100:00100000:3.0:1775764874.483131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764874.483310:0:6523:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076168192 00000100:00100000:0.0:1775764874.483321:0:6523:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076168192 00000100:00100000:0.0:1775764874.483385:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6669 00000100:00100000:0.0:1775764874.483396:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+59:50396:x1862023076168192:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1775764874.483513:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2bb64567-481f-43c2-999a-8c9c071338ae+59:50396:x1862023076168192:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764874.483522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6669 00000100:00100000:1.0:1775764874.503587:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764874.503659:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076168320 00000100:00100000:2.0:1775764874.503671:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076168320 00000100:00100000:2.0:1775764874.503736:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1766 00000100:00100000:2.0:1775764874.503746:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076168320:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764874.503767:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764874.503822:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd56f9 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1775764874.503850:0:15167:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x58:0x0] initial LVB size: 1516, mtime: 0x69d80589, atime: 0x0, ctime: 0x69d80589, blocks: 0x8 00010000:00010000:2.0:1775764874.503871:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764874.503873:0:15167:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764874.503882:0:15167:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.503920:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 9 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.503944:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cea00, rc 0) 00000100:00100000:2.0:1775764874.504001:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076168320:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 256us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764874.504009:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1766 00000100:00100000:0.0:1775764874.513176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764874.513346:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076168576 00000100:00100000:3.0:1775764874.513356:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076168576 00000100:00100000:3.0:1775764874.513432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6670 00000100:00100000:3.0:1775764874.513442:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:50396:x1862023076168576:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1775764874.513575:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:50396:x1862023076168576:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764874.513583:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6670 00000100:00100000:0.0:1775764874.519356:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764874.523125:0:8410:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076168704 00000100:00100000:1.0:1775764874.523144:0:8410:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076168704 00002000:00100000:1.0:1775764874.523235:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x58:0x0] (0->4095) req@ffff96c1c4d91880 x1862023076168704/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:355/0 lens 488/0 e 0 to 0 dl 1775764885 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764874.523247:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4d91880 with x1862023076168704 ext(0->4095) 00002000:00010000:1.0:1775764874.523252:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c4d91880 00000100:00100000:1.0:1775764874.523281:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 439 00000100:00100000:1.0:1775764874.523290:0:8410:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076168704:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1775764874.523485:0:8410:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076168704:12345-192.168.202.58@tcp:3:lhsmtool_posix.0 Request processed in 195us (4144us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1775764874.523493:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 439 00002000:00100000:1.0:1775764874.523500:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x58:0x0] (0->4095) req@ffff96c1c4d91880 x1862023076168704/t0(0) o3->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:355/0 lens 488/4536 e 0 to 0 dl 1775764885 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1775764874.523508:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c4d91880 with x1862023076168704 ext(0->4095) 00002000:00010000:1.0:1775764874.523511:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96c1c4d91880 00000100:00100000:1.0:1775764874.533682:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764874.533798:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076168832 00000100:00100000:0.0:1775764874.533810:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076168832 00000100:00100000:0.0:1775764874.533888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6671 00000100:00100000:0.0:1775764874.533899:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+59:50396:x1862023076168832:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764874.533921:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764874.533953:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed524350 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5700 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.533988:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.534002:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.534015:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.534151:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed524350 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.534170:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.534179:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:0.0:1775764874.534182:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764874.534187:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2de00, rc 0) 00000100:00100000:0.0:1775764874.534247:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076168832:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 350us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764874.534255:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6671 00000100:00100000:1.0:1775764874.554199:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764874.554329:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076168960 00000100:00100000:0.0:1775764874.554340:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076168960 00000100:00100000:0.0:1775764874.554400:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6672 00000100:00100000:0.0:1775764874.554411:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076168960:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1775764874.554442:0:10088:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1775764874.554546:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076168960:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 137us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764874.554554:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6672 00000100:00100000:2.0:1775764874.573367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764874.573406:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076169088 00000100:00100000:2.0:1775764874.573416:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076169088 00000100:00100000:2.0:1775764874.573471:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1767 00000100:00100000:2.0:1775764874.573481:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076169088:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1775764874.573529:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573547:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764874.573549:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1775764874.573554:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573571:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573596:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573622:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573631:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573637:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cee00 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:2.0:1775764874.573641:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573651:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573667:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.573675:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831df33a/0x6e98bd47ed52435e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764874.573754:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076169088:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 Request processed in 274us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764874.573762:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1767 00000100:00100000:1.0:1775764874.589538:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764874.591419:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076169344 00000100:00100000:3.0:1775764874.591435:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076169344 00000100:00100000:3.0:1775764874.591557:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6673 00000100:00100000:3.0:1775764874.591569:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076169344:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1775764874.591675:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.591695:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.591705:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 4/0,1 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.591744:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764874.591764:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 60 pid: 6522 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764874.591796:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099847296:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764874.600102:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c3752480 going to sleep for 11 seconds 00000100:00100000:3.0:1775764874.604988:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764874.605108:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099847296:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764874.605139:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764874.605242:0:6506:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076169472 00000100:00100000:2.0:1775764874.605252:0:6506:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076169472 00010000:00010000:2.0:1775764874.605290:0:6506:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 61 pid: 6522 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764874.605347:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1443 00000100:00100000:2.0:1775764874.605359:0:6506:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+61:2410:x1862023076169472:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764874.605377:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764874.605385:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 61 pid: 6522 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.605399:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 61 pid: 6522 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.605425:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2de00/0x6e98bd47ed524357 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5700 expref: 61 pid: 6522 timeout: 1482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.605442:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:2.0:1775764874.605448:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.605458:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.605466:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764874.605497:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764874.605554:0:6506:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bb64567-481f-43c2-999a-8c9c071338ae+60:2410:x1862023076169472:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 198us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764874.605563:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1443 00010000:00010000:0.0:1775764874.608081:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608113:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608299:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608307:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608315:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608321:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c0e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764874.608325:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608335:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608352:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:0.0:1775764874.608356:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764874.608361:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 2/0,0 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764874.608368:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0e00/0x6e98bd47ed524365 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764874.608512:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076169344:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 16940us (18978us total) trans 4294970724 rc 0/0 00000100:00100000:0.0:1775764874.608522:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6673 00000040:00080000:0.0:1775764874.608648:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764874.608653:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764874.609182:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1775764874.609191:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764874.623575:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764874.623728:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076169728 00000100:00100000:1.0:1775764874.623739:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076169728 00000100:00100000:1.0:1775764874.623862:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1389 00000100:00100000:1.0:1775764874.623874:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+60:50396:x1862023076169728:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764874.624183:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+61:50396:x1862023076169728:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 311us (617us total) trans 4294970725 rc 0/0 00000100:00100000:1.0:1775764874.624191:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1389 00000040:00080000:0.0:1775764874.914042:0:32599:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764874.914052:0:32599:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764874.914103:0:32599:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 158 count 6 00000040:00080000:0.0:1775764874.914110:0:32599:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764875.060954:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c498ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099847424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764875.061039:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764875.061132:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099847424 00000100:00100000:3.0:1775764875.061140:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099847424 00000100:00100000:3.0:1775764875.061187:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1775764875.061196:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099847424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764875.061231:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764875.063460:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099847424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2252us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764875.063474:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1775764875.063565:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c498ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099847424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764875.140729:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764875.397597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397641:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397666:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397707:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397725:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764875.397802:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170368 00000100:00100000:0.0:1775764875.397812:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170368 00000100:00100000:0.0:1775764875.397876:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076169984 00000100:00100000:0.0:1775764875.397879:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076169984 00000100:00100000:0.0:1775764875.397893:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170240 00000100:00100000:0.0:1775764875.397895:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170240 00000100:00100000:0.0:1775764875.397913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2024 00000100:00100000:0.0:1775764875.397930:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076170368:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764875.398005:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2410:x1862023076170368:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764875.398011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2024 00000100:00100000:0.0:1775764875.398030:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2025 00000100:00100000:0.0:1775764875.398036:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076169984:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764875.398069:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2410:x1862023076169984:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764875.398075:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2025 00000100:00100000:0.0:1775764875.398083:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2026 00000100:00100000:0.0:1775764875.398088:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:2410:x1862023076170240:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764875.398104:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:2410:x1862023076170240:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 16us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764875.398109:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2026 00000100:00100000:3.0:1775764875.398191:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170112 00000100:00100000:3.0:1775764875.398196:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170112 00000100:00100000:3.0:1775764875.398235:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170624 00000100:00100000:3.0:1775764875.398238:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170624 00000100:00100000:3.0:1775764875.398255:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170496 00000100:00100000:3.0:1775764875.398257:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170496 00000100:00100000:3.0:1775764875.398275:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1480 00000100:00100000:3.0:1775764875.398281:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076170112:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764875.398316:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076170112:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 35us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764875.398322:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1480 00000100:00100000:3.0:1775764875.398335:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1481 00000100:00100000:3.0:1775764875.398341:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076170624:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764875.398362:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076170624:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764875.398373:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1481 00000100:00100000:3.0:1775764875.398382:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1482 00000100:00100000:3.0:1775764875.398387:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076170496:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764875.398405:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2410:x1862023076170496:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 18us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764875.398411:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1482 00000100:00080000:3.0:1775764875.398430:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764875.398433:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764875.398436:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764875.398437:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764875.398943:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076169856 00000100:00100000:1.0:1775764875.398954:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076169856 00000100:00100000:1.0:1775764875.398984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 989 00000100:00100000:1.0:1775764875.398990:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076169856:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764875.399017:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2410:x1862023076169856:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.399023:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 989 00000100:00100000:1.0:1775764875.571946:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099847552:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572029:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572080:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099848064:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572106:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572126:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099848576:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572151:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572169:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099849088:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572187:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572210:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1775764875.572215:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099847936:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572238:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572256:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099848448:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572275:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572290:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099848960:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572308:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572337:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099847680:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572358:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572375:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099848192:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572406:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572423:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099848704:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572442:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572461:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1775764875.572466:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099847808:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572486:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572504:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099848320:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572523:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572538:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099848832:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572556:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764875.572589:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099847552 00000100:00100000:1.0:1775764875.572604:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099847552 00000100:00100000:1.0:1775764875.572648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1775764875.572656:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099847552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572704:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099847552:12345-0@lo:400:kworker.0 Request processed in 49us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.572711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1775764875.572746:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848064 00000100:00100000:1.0:1775764875.572750:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848064 00000100:00100000:1.0:1775764875.572798:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099847808 00000100:00100000:1.0:1775764875.572802:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099847808 00000100:00100000:1.0:1775764875.572817:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1775764875.572822:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099848064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572856:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099848064:12345-0@lo:400:kworker.0 Request processed in 34us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.572862:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1775764875.572880:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1775764875.572885:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099847808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.572928:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099847808:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.572935:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1775764875.572954:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848576 00000100:00100000:1.0:1775764875.572958:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848576 00000100:00100000:1.0:1775764875.572983:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849088 00000100:00100000:1.0:1775764875.572986:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849088 00000100:00100000:1.0:1775764875.573011:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848448 00000100:00100000:1.0:1775764875.573014:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848448 00000100:00100000:1.0:1775764875.573024:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848960 00000100:00100000:1.0:1775764875.573026:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848960 00000100:00100000:1.0:1775764875.573039:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1775764875.573045:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099848576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573075:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099848576:12345-0@lo:400:kworker.0 Request processed in 31us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573081:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1775764875.573092:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1775764875.573098:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099849088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573122:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099849088:12345-0@lo:400:kworker.0 Request processed in 25us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573128:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1775764875.573138:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1775764875.573143:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099848448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573168:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099848448:12345-0@lo:400:kworker.0 Request processed in 25us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573181:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1775764875.573191:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1775764875.573196:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573220:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099848960:12345-0@lo:400:kworker.0 Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573225:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1775764875.573245:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099847936 00000100:00100000:1.0:1775764875.573248:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099847936 00000100:00100000:1.0:1775764875.573270:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099847680 00000100:00100000:1.0:1775764875.573273:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099847680 00000100:00100000:1.0:1775764875.573282:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848192 00000100:00100000:1.0:1775764875.573284:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848192 00000100:00100000:1.0:1775764875.573295:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848704 00000100:00100000:1.0:1775764875.573298:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848704 00000100:00100000:1.0:1775764875.573307:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848320 00000100:00100000:1.0:1775764875.573309:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848320 00000100:00100000:1.0:1775764875.573319:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099848832 00000100:00100000:1.0:1775764875.573321:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099848832 00000100:00100000:1.0:1775764875.573334:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1775764875.573339:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099847936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573365:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099847936:12345-0@lo:400:kworker.0 Request processed in 26us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573370:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1775764875.573381:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1775764875.573386:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099847680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573408:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099847680:12345-0@lo:400:kworker.0 Request processed in 22us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573413:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1775764875.573431:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1775764875.573437:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099848192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573461:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1862023099848192:12345-0@lo:400:kworker.0 Request processed in 24us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573466:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1775764875.573475:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1775764875.573480:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573504:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1862023099848704:12345-0@lo:400:kworker.0 Request processed in 24us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573509:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1775764875.573519:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1775764875.573524:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099848320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573550:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099848320:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573555:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1775764875.573565:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:1.0:1775764875.573570:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099848832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573593:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099848832:12345-0@lo:400:kworker.0 Request processed in 24us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764875.573598:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00080000:1.0:1775764875.573652:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1775764875.573656:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1775764875.573659:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764875.573693:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099847808:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573705:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099848320:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573726:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099848832:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573737:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099847680:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573746:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3663:1862023099848192:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573756:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3663:1862023099848704:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573819:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099847936:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573829:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099848448:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573839:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099848960:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573848:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099847552:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573856:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099848064:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573866:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099848576:0@lo:400:kworker.0 00000100:00100000:1.0:1775764875.573875:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099849088:0@lo:400:kworker.0 00000040:00080000:0.0:1775764875.633980:0:13646:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764875.633991:0:13646:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764875.634105:0:13646:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 158 count 2 00000040:00080000:0.0:1775764875.634114:0:13646:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764876.085474:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099849216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1775764876.085554:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764876.085620:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1775764876.085628:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099849344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764876.085654:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764876.086995:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849216 00000100:00100000:1.0:1775764876.087010:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849216 00000100:00100000:1.0:1775764876.087061:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849344 00000100:00100000:1.0:1775764876.087064:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849344 00000100:00100000:1.0:1775764876.087081:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1775764876.087090:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c498ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099849216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764876.087125:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:1.0:1775764876.087198:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c498ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099849216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764876.087206:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1775764876.087829:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1775764876.087837:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099849344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764876.087855:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:1.0:1775764876.087891:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099849344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764876.087897:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1775764876.087962:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099849344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764876.087978:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099849216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1775764876.146008:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764877.173867:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764878.133752:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099849472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1775764878.133852:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764878.133931:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849472 00000100:00100000:0.0:1775764878.133938:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849472 00000100:00100000:0.0:1775764878.133985:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1775764878.133992:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099849472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1775764878.134023:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444212736 avail 1297973248 00000100:00100000:0.0:1775764878.134077:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1862023099849472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764878.134083:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1775764878.134137:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099849472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1775764878.195027:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764878.197872:0:13648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764878.197882:0:13648:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764878.198484:0:13648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1775764878.198494:0:13648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764879.155998:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f728b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099849600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764879.156029:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c61adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099849728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764879.157504:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764879.159294:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764879.159453:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849600 00000100:00100000:3.0:1775764879.159462:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849600 00000100:00100000:3.0:1775764879.159529:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849728 00000100:00100000:3.0:1775764879.159533:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849728 00000100:00100000:3.0:1775764879.159552:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1775764879.159560:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c72e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099849600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1775764879.159593:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50815168 pending 28672 free 3916951552 avail 3685429248 00000100:00100000:0.0:1775764879.159602:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1775764879.159611:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099849728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764879.159622:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50815168 pending 28672 free 3916951552 avail 3685429248 00000100:00100000:0.0:1775764879.159677:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099849728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764879.159684:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1775764879.159748:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c61adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099849728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764879.160598:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c72e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099849600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1036us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764879.161073:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:3.0:1775764879.161106:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764879.164693:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f728b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099849600:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1775764879.172028:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970725 is committed 00000001:00080000:1.0:1775764879.172068:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970719 is committed 00010000:00010000:1.0:1775764879.172153:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.172166:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.172174:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.172180:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403e800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764879.172185:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.172193:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173642:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c2c7e0f200) 00010000:00010000:1.0:1775764879.173649:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764879.173667:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173676:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e800/0x6e98bd47ed5242d2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173754:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173762:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173767:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173786:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764879.173790:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173797:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173809:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x716374db (ffff96c1c7207800) 00010000:00010000:1.0:1775764879.173811:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764879.173814:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173820:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed5241f9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x716374db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173844:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173859:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173865:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173870:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764879.173873:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173879:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173899:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764879.173902:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764879.173904:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764879.173910:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed524200 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764879.229577:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764880.183377:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1775764880.183405:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099849856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1775764880.183484:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764880.183590:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849856 00000100:00100000:3.0:1775764880.183599:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849856 00000100:00100000:3.0:1775764880.186099:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1775764880.186120:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099849856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1775764880.186168:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1775764880.186268:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099849856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764880.192520:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099849856:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1775764880.193374:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967731 is committed 00000100:00100000:3.0:1775764880.196921:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00010000:00010000:0.0:1775764880.251300:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764880.514934:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515049:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515069:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515108:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515129:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.515148:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.516356:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764880.516400:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171264 00000100:00100000:3.0:1775764880.516411:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171264 00000100:00100000:3.0:1775764880.516469:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171776 00000100:00100000:3.0:1775764880.516472:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171776 00000100:00100000:3.0:1775764880.516491:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171136 00000100:00100000:3.0:1775764880.516493:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171136 00000100:00100000:3.0:1775764880.516506:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171648 00000100:00100000:3.0:1775764880.516508:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171648 00000100:00100000:3.0:1775764880.516522:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1487 00000100:00100000:3.0:1775764880.516531:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076171264:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.516606:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076171264:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 75us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.516614:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1487 00000100:00100000:3.0:1775764880.516631:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1488 00000100:00100000:3.0:1775764880.516638:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076171776:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.516663:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076171776:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.516669:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1488 00000100:00100000:3.0:1775764880.516681:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1489 00000100:00100000:3.0:1775764880.516686:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076171136:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.516707:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+7:2411:x1862023076171136:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.516713:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1489 00000100:00100000:3.0:1775764880.516722:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1490 00000100:00100000:3.0:1775764880.516727:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076171648:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.516764:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076171648:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.516788:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1490 00000100:00100000:3.0:1775764880.516809:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171008 00000100:00100000:3.0:1775764880.516814:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171008 00000100:00100000:3.0:1775764880.516847:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171520 00000100:00100000:3.0:1775764880.516850:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171520 00000100:00100000:3.0:1775764880.516868:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170880 00000100:00100000:3.0:1775764880.516871:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170880 00000100:00100000:3.0:1775764880.516902:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171392 00000100:00100000:3.0:1775764880.516905:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171392 00000100:00100000:3.0:1775764880.516919:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2033 00000100:00100000:3.0:1775764880.516925:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076171008:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.516954:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076171008:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 30us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.516960:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2033 00000100:00100000:3.0:1775764880.516972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2034 00000100:00100000:3.0:1775764880.516978:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076171520:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.517000:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076171520:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.517006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2034 00000100:00100000:3.0:1775764880.517015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2035 00000100:00100000:3.0:1775764880.517021:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+53:2411:x1862023076170880:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.517049:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+53:2411:x1862023076170880:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 28us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.517064:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2035 00000100:00100000:3.0:1775764880.517076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2036 00000100:00100000:3.0:1775764880.517082:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2411:x1862023076171392:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764880.517105:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2411:x1862023076171392:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764880.517111:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2036 00000100:00080000:3.0:1775764880.517151:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764880.517156:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764880.517159:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764880.517161:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764880.522211:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076170752 00000100:00100000:2.0:1775764880.522226:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076170752 00000100:00100000:2.0:1775764880.522309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 991 00000100:00100000:2.0:1775764880.522320:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076170752:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764880.522403:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076170752:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 85us (7476us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764880.522410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 991 00000100:00100000:0.0:1775764880.702301:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099850112:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.702367:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.702417:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099850624:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.702438:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.702454:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099851136:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.702472:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.702495:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1775764880.702501:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099849984:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.702526:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.702561:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099850496:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.702582:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.703749:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099851008:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.703810:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.703857:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099850240:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.703903:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.703923:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099850752:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.703945:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.703963:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099851264:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.703983:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.704008:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1775764880.704015:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c72e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099850368:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704035:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.704052:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099850880:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704070:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.704084:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099851392:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704101:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764880.704133:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850112 00000100:00100000:0.0:1775764880.704141:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850112 00000100:00100000:0.0:1775764880.704184:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850624 00000100:00100000:0.0:1775764880.704187:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850624 00000100:00100000:0.0:1775764880.704209:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851136 00000100:00100000:0.0:1775764880.704212:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851136 00000100:00100000:0.0:1775764880.704222:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850496 00000100:00100000:0.0:1775764880.704224:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850496 00000100:00100000:0.0:1775764880.704233:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851008 00000100:00100000:0.0:1775764880.704235:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851008 00000100:00100000:0.0:1775764880.704243:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850368 00000100:00100000:0.0:1775764880.704245:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850368 00000100:00100000:0.0:1775764880.704257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1775764880.704265:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099850112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704317:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1862023099850112:12345-0@lo:400:kworker.0 Request processed in 52us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764880.704330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1775764880.704346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:0.0:1775764880.704352:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099850624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704380:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1862023099850624:12345-0@lo:400:kworker.0 Request processed in 28us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764880.704386:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:0.0:1775764880.704397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1775764880.704402:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099851136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704426:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1862023099851136:12345-0@lo:400:kworker.0 Request processed in 24us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764880.704431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1775764880.704443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:0.0:1775764880.704449:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099850496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704476:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099850496:12345-0@lo:400:kworker.0 Request processed in 29us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764880.704481:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:0.0:1775764880.704491:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1775764880.704496:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099851008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704517:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099851008:12345-0@lo:400:kworker.0 Request processed in 22us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764880.704523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1775764880.704546:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1775764880.704552:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099850368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.704579:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099850368:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.704860:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850752 00000100:00100000:1.0:1775764880.704865:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850752 00000100:00100000:1.0:1775764880.704907:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851264 00000100:00100000:1.0:1775764880.704910:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851264 00000100:00100000:1.0:1775764880.704931:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850880 00000100:00100000:1.0:1775764880.704933:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850880 00000100:00100000:1.0:1775764880.704943:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851392 00000100:00100000:1.0:1775764880.704945:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851392 00000100:00100000:1.0:1775764880.704959:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1775764880.704965:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099850752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764880.705008:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099850752:12345-0@lo:400:kworker.0 Request processed in 43us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.705015:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1775764880.705028:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1775764880.705034:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099851264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764880.705059:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099851264:12345-0@lo:400:kworker.0 Request processed in 26us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.705065:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1775764880.705075:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1775764880.705080:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099850880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764880.705103:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099850880:12345-0@lo:400:kworker.0 Request processed in 23us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.705108:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1775764880.705117:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1775764880.705121:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099851392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764880.705144:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099851392:12345-0@lo:400:kworker.0 Request processed in 23us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.705149:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1775764880.705184:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099850240 00000100:00100000:1.0:1775764880.705188:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099850240 00000100:00100000:1.0:1775764880.705212:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1775764880.705217:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d1200c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099850240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764880.705248:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d1200c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099850240:12345-0@lo:400:kworker.0 Request processed in 31us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.705254:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1775764880.705651:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099849984 00000100:00100000:1.0:1775764880.705655:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099849984 00000100:00100000:1.0:1775764880.705681:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1775764880.705688:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099849984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764880.705722:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099849984:12345-0@lo:400:kworker.0 Request processed in 35us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764880.705728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1775764880.706093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00080000:0.0:1775764880.706127:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1775764880.706132:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1775764880.706134:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1775764880.706236:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099849984:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706256:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099850496:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706267:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099851008:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706279:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3662:1862023099850112:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706289:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3662:1862023099850624:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706299:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3662:1862023099851136:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706341:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099850368:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706352:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099850880:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706362:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099851392:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706371:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c72e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099850240:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706380:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099850752:0@lo:400:kworker.0 00000100:00100000:0.0:1775764880.706390:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099851264:0@lo:400:kworker.0 00000100:00100000:0.0:1775764881.202023:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f728aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099851520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764881.202142:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764881.202385:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1775764881.202393:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099851648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764881.202431:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764881.203424:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851520 00000100:00100000:1.0:1775764881.203435:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851520 00000100:00100000:1.0:1775764881.203600:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851648 00000100:00100000:1.0:1775764881.203604:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851648 00000100:00100000:2.0:1775764881.203699:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1775764881.203711:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099851520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1775764881.203746:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:2.0:1775764881.203837:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099851520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764881.203845:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1775764881.203864:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1775764881.203883:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099851648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764881.203893:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:2.0:1775764881.203928:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099851648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764881.203934:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1775764881.204153:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099851648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764881.204181:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f728aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099851520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1775764881.266182:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764882.055149:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764882.055201:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076171904 00000100:00100000:3.0:1775764882.055211:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076171904 00000100:00100000:3.0:1775764882.055291:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1462 00000100:00100000:3.0:1775764882.055302:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2409:x1862023076171904:12345-192.168.202.58@tcp:63:ll_sa.0 00010000:00010000:3.0:1775764882.055340:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764882.055361:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed52436c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5707 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055433:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055447:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055464:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055498:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055506:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055514:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055556:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055563:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055570:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055576:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764882.055580:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055588:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055601:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764882.055604:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764882.055608:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055615:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524373 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055636:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055642:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055648:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055653:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764882.055656:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055662:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055672:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0xb6764e97 (ffff96c1c2a03b00) 00010000:00010000:3.0:1775764882.055675:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764882.055678:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055685:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1000/0x6e98bd47ed52437a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0xb6764e97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055716:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed52436c lrc: 1/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5707 expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055726:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff96c1c7207000) 00010000:00010000:3.0:1775764882.055729:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1775764882.055739:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed52436c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5707 expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764882.055749:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc -2) 00000100:00100000:3.0:1775764882.055831:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2409:x1862023076171904:12345-192.168.202.58@tcp:63:ll_sa.0 Request processed in 531us (692us total) trans 0 rc -2/-2 00000100:00100000:3.0:1775764882.055840:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1462 00000100:00080000:1.0:1775764882.060497:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1775764882.296891:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764882.800488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764882.800539:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172032 00000100:00100000:1.0:1775764882.800550:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172032 00000100:00100000:1.0:1775764882.800625:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1768 00000100:00080000:0.0:1775764882.800626:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1775764882.800634:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076172032:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764882.800651:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764882.800669:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd570e expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.800691:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764882.800694:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764882.800702:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.800719:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.800755:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403ea00, rc 0) 00000100:00100000:1.0:1775764882.800847:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076172032:12345-192.168.202.58@tcp:101:rm.0 Request processed in 215us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764882.800862:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1768 00000100:00100000:3.0:1775764882.813083:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764882.813912:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172288 00000100:00100000:1.0:1775764882.813925:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172288 00000100:00100000:1.0:1775764882.814022:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6674 00000100:00100000:1.0:1775764882.814032:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:50472:x1862023076172288:12345-192.168.202.58@tcp:36:rm.0 00010000:00010000:1.0:1775764882.814177:0:24980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1775764882.814205:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed52430a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56d6 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814223:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764882.814233:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0000/0x6e98bd47ed52431f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56e4 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814242:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764882.814246:0:24980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764882.814265:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814277:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814286:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814312:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814319:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814326:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814429:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814439:0:24980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814447:0:24980:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814481:0:24980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.814495:0:24980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 52 pid: 6522 timeout: 1490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764882.814511:0:24980:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f728bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099851776:192.168.202.58@tcp:104: 00000100:00100000:1.0:1775764882.814609:0:24980:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d127e300 going to sleep for 11 seconds 00000100:00100000:0.0:1775764882.818366:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764882.819402:0:24980:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f728bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:24980:1862023099851776:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764882.819437:0:24980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764882.822121:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172416 00000100:00100000:2.0:1775764882.822136:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172416 00010000:00010000:2.0:1775764882.822197:0:8419:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 53 pid: 6522 timeout: 1490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764882.822235:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1444 00000100:00100000:2.0:1775764882.822246:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+53:2410:x1862023076172416:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764882.822259:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764882.822266:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 53 pid: 6522 timeout: 1490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764882.822278:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 53 pid: 6522 timeout: 1490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764882.822298:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5242d9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56c1 expref: 53 pid: 6522 timeout: 1490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764882.822310:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:2.0:1775764882.822314:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764882.822323:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764882.822329:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764882.822361:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1775764882.822425:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:2410:x1862023076172416:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 181us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764882.822432:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1444 00010000:00010000:1.0:1775764882.822486:0:24980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.822496:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1775764882.822591:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1775764882.823468:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].70, 64 off13512 00000004:00080000:1.0:1775764882.823485:0:24980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1390644713243ns, next at 1391644709137ns, rc = 0 00010000:00010000:1.0:1775764882.823550:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823564:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823653:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823663:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823669:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823675:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823766:0:24980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:1.0:1775764882.823875:0:24980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].158, 136 off29472 00010000:00010000:1.0:1775764882.823907:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823928:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823935:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823941:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764882.823946:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823953:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823964:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:1.0:1775764882.823966:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1775764882.823971:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823977:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f400/0x6e98bd47ed524396 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.823998:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824004:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824010:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824017:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824028:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403ee00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764882.824031:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824037:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824044:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0x0 (ffff96c1c7207d00) 00010000:00010000:1.0:1775764882.824047:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764882.824049:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824054:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed524388 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764882.824063:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c115401f reply state 00000000a7fafb58 transno 4294970726 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824076:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764882.824081:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764882.824084:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764882.824087:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1775764882.824185:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:50472:x1862023076172288:12345-192.168.202.58@tcp:36:rm.0 Request processed in 10151us (11107us total) trans 4294970726 rc 0/0 00000100:00100000:1.0:1775764882.824195:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6674 00010000:00010000:0.0:1775764882.824523:0:9476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1775764882.824530:0:9476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764882.824536:0:9476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403e200 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:0.0:1775764882.824540:0:9476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764882.824546:0:9476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764882.824556:0:9476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2c7e0fa00) 00010000:00010000:0.0:1775764882.824558:0:9476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1775764882.824561:0:9476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 1/0,0 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764882.824673:0:9476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed52439d lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764882.824692:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764882.824694:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1775764882.824696:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1775764883.250981:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099851904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1775764883.251053:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764883.251600:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099851904 00000100:00100000:0.0:1775764883.251609:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099851904 00000100:00100000:0.0:1775764883.251678:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:0.0:1775764883.251686:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099851904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1775764883.251723:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444212736 avail 1297973248 00000100:00100000:0.0:1775764883.251795:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1862023099851904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764883.251803:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:0.0:1775764883.251863:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099851904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1775764883.314887:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764883.697361:0:33035:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764883.697368:0:33035:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764883.697401:0:33035:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 3 00000040:00080000:3.0:1775764883.697408:0:33035:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1775764884.275010:0:8640:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1392096236239ns, next at 1393096233714ns, rc = 0 00000100:00100000:0.0:1775764884.275033:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1775764884.275052:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099852032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764884.275121:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764884.275183:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852032 00000100:00100000:0.0:1775764884.275190:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852032 00000100:00100000:0.0:1775764884.275249:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1775764884.275258:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099852032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764884.275291:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50786496 pending 0 free 3916951552 avail 3685429248 00000100:00100000:0.0:1775764884.275338:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099852032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764884.275346:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00080000:0.0:1775764884.275369:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764884.275416:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099852032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764884.275564:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f7289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099852160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1775764884.275591:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764884.275654:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852160 00000100:00100000:1.0:1775764884.275659:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852160 00000100:00100000:1.0:1775764884.275697:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1775764884.275705:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099852160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1775764884.275716:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50786496 pending 0 free 3916951552 avail 3685429248 00000100:00100000:1.0:1775764884.275749:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099852160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764884.275756:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00080000:0.0:1775764884.275824:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764884.275857:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f7289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099852160:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1775764884.337936:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1775764884.640092:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764884.640102:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764884.640142:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 3 00000040:00080000:3.0:1775764884.640152:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764885.300198:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1775764885.300222:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099852288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1775764885.300303:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764885.301382:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852288 00000100:00100000:2.0:1775764885.301393:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852288 00000100:00100000:2.0:1775764885.301453:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1775764885.301464:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099852288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1775764885.301502:0:6526:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:2.0:1775764885.301576:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099852288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.301584:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1775764885.301748:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099852288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1775764885.365450:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764885.544293:0:33136:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764885.544302:0:33136:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764885.544996:0:33136:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764885.545008:0:33136:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764885.644696:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646726:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646792:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646856:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646895:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646914:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646939:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764885.646973:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173056 00000100:00100000:0.0:1775764885.646982:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173056 00000100:00100000:0.0:1775764885.647040:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173568 00000100:00100000:0.0:1775764885.647043:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173568 00000100:00100000:0.0:1775764885.647066:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172928 00000100:00100000:0.0:1775764885.647068:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172928 00000100:00100000:0.0:1775764885.647083:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173440 00000100:00100000:0.0:1775764885.647086:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173440 00000100:00100000:0.0:1775764885.647103:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1495 00000100:00100000:0.0:1775764885.647114:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2408:x1862023076173056:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764885.647193:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+8:2408:x1862023076173056:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 82us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764885.647202:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1495 00000100:00100000:0.0:1775764885.647219:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1496 00000100:00100000:0.0:1775764885.647225:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2408:x1862023076173568:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764885.647249:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2408:x1862023076173568:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764885.647255:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1496 00000100:00100000:0.0:1775764885.647278:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1497 00000100:00100000:0.0:1775764885.647283:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076172928:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764885.647309:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076172928:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764885.647315:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1497 00000100:00100000:0.0:1775764885.647325:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1498 00000100:00100000:0.0:1775764885.647330:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076173440:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764885.647351:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076173440:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764885.647357:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1498 00000100:00100000:0.0:1775764885.647375:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172800 00000100:00100000:0.0:1775764885.647379:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172800 00000100:00100000:0.0:1775764885.647407:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173312 00000100:00100000:0.0:1775764885.647411:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173312 00000100:00100000:0.0:1775764885.647427:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172672 00000100:00100000:0.0:1775764885.647429:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172672 00000100:00100000:0.0:1775764885.647443:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173184 00000100:00100000:0.0:1775764885.647445:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173184 00000100:00100000:0.0:1775764885.647457:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2043 00000100:00100000:0.0:1775764885.647462:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076172800:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764885.647487:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076172800:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764885.647493:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2043 00000100:00100000:0.0:1775764885.647504:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2044 00000100:00100000:0.0:1775764885.647510:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076173312:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764885.647533:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076173312:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.647678:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2045 00000100:00100000:3.0:1775764885.647688:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:2408:x1862023076172672:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764885.647718:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:2408:x1862023076172672:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 34us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.647725:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2045 00000100:00100000:3.0:1775764885.647754:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2046 00000100:00100000:3.0:1775764885.647760:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2408:x1862023076173184:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764885.647805:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:2408:x1862023076173184:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 45us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.647820:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2046 00000100:00100000:0.0:1775764885.650686:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2044 00000100:00080000:0.0:1775764885.650844:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1775764885.650850:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1775764885.650854:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1775764885.650856:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764885.652750:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076172544 00000100:00100000:1.0:1775764885.652791:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076172544 00000100:00100000:1.0:1775764885.652867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 993 00000100:00100000:1.0:1775764885.652877:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076172544:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764885.652963:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076172544:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 88us (8277us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764885.652971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 993 00000040:00080000:1.0:1775764885.688914:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764885.688924:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764885.689014:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 2 00000040:00080000:1.0:1775764885.689030:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764885.811485:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099852416:0@lo:400:kworker.0 00000100:00100000:0.0:1775764885.811565:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764885.811653:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852416 00000100:00100000:1.0:1775764885.811662:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852416 00000100:00100000:1.0:1775764885.811720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1775764885.811730:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814240:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099852544:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814313:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814356:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099853056:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814378:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814399:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099853568:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814419:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814444:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1775764885.814451:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099852928:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814475:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814505:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099853440:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814531:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814565:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099852800:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814588:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814607:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099853312:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814631:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814650:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099853824:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814671:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814688:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1775764885.814694:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099852672:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814716:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814734:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099853184:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814753:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764885.814921:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099853696:0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.814945:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764885.815644:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3663:x1862023099852416:12345-0@lo:400:kworker.0 Request processed in 3911us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764885.815656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1775764885.815714:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852672 00000100:00100000:1.0:1775764885.815722:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852672 00000100:00100000:1.0:1775764885.815841:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1775764885.815850:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099852672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764885.815911:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099852672:12345-0@lo:400:kworker.0 Request processed in 63us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764885.815918:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1775764885.815975:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852544 00000100:00100000:2.0:1775764885.815981:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852544 00000100:00100000:2.0:1775764885.816013:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853056 00000100:00100000:2.0:1775764885.816016:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853056 00000100:00100000:2.0:1775764885.816040:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853568 00000100:00100000:2.0:1775764885.816043:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853568 00000100:00100000:2.0:1775764885.816055:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852928 00000100:00100000:2.0:1775764885.816058:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852928 00000100:00100000:2.0:1775764885.816070:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853440 00000100:00100000:2.0:1775764885.816072:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853440 00000100:00100000:2.0:1775764885.816084:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099852800 00000100:00100000:2.0:1775764885.816087:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099852800 00000100:00100000:2.0:1775764885.816101:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1775764885.816107:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099852544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816157:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1862023099852544:12345-0@lo:400:kworker.0 Request processed in 50us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.816175:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1775764885.816192:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1775764885.816197:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099853056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816227:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1862023099853056:12345-0@lo:400:kworker.0 Request processed in 30us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.816233:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1775764885.816243:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1775764885.816248:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099853568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816275:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1862023099853568:12345-0@lo:400:kworker.0 Request processed in 26us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.816279:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1775764885.816290:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:2.0:1775764885.816296:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c61adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099852928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816322:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c61adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099852928:12345-0@lo:400:kworker.0 Request processed in 26us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.816328:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:2.0:1775764885.816338:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1775764885.816344:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099853440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816370:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099853440:12345-0@lo:400:kworker.0 Request processed in 26us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.816376:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1775764885.816386:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1775764885.816391:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099852800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816416:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1862023099852800:12345-0@lo:400:kworker.0 Request processed in 25us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764885.816427:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00080000:2.0:1775764885.816450:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1775764885.816454:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1775764885.816486:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099852928:0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816513:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099853440:0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816524:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3664:1862023099852544:0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816534:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3664:1862023099853056:0@lo:400:kworker.0 00000100:00100000:2.0:1775764885.816620:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3664:1862023099853568:0@lo:400:kworker.0 00000100:00100000:0.0:1775764885.816720:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3663:1862023099852416:0@lo:400:kworker.0 00000100:00100000:1.0:1775764885.817204:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099852672:0@lo:400:kworker.0 00000100:00100000:1.0:1775764885.817216:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3662:1862023099852800:0@lo:400:kworker.0 00000100:00100000:0.0:1775764885.817352:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853312 00000100:00100000:0.0:1775764885.817358:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853312 00000100:00100000:0.0:1775764885.817426:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853824 00000100:00100000:0.0:1775764885.817430:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853824 00000100:00080000:2.0:1775764885.817478:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764885.817626:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853184 00000100:00100000:3.0:1775764885.817631:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853184 00000100:00100000:3.0:1775764885.817663:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853696 00000100:00100000:3.0:1775764885.817666:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853696 00000100:00100000:3.0:1775764885.817692:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1775764885.817699:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099853312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.817754:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099853312:12345-0@lo:400:kworker.0 Request processed in 56us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.817761:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1775764885.817800:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1775764885.817807:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099853824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.817846:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1862023099853824:12345-0@lo:400:kworker.0 Request processed in 40us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.817851:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1775764885.817863:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1775764885.817869:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099853184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.817896:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099853184:12345-0@lo:400:kworker.0 Request processed in 28us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.817903:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1775764885.817915:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1775764885.817922:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099853696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764885.817949:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099853696:12345-0@lo:400:kworker.0 Request processed in 27us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764885.817954:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00080000:2.0:1775764885.818068:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1775764885.818219:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099853184:0@lo:400:kworker.0 00000100:00100000:1.0:1775764885.818231:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099853696:0@lo:400:kworker.0 00000100:00100000:1.0:1775764885.818241:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099853312:0@lo:400:kworker.0 00000100:00100000:1.0:1775764885.818250:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3662:1862023099853824:0@lo:400:kworker.0 00000100:00100000:1.0:1775764886.322132:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1775764886.322158:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f728ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099853952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1775764886.322232:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764886.322323:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099853952 00000100:00100000:1.0:1775764886.322333:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099853952 00000100:00100000:1.0:1775764886.322380:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1775764886.322389:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099853952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1775764886.322419:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:1.0:1775764886.322463:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099853952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764886.322470:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1775764886.322517:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f728ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099853952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1775764886.322916:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1775764886.322926:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099854080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1775764886.322960:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764886.322999:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099854080 00000100:00100000:3.0:1775764886.323003:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099854080 00000100:00100000:3.0:1775764886.323028:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1775764886.323035:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099854080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1775764886.323061:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:3.0:1775764886.323093:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099854080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764886.323100:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1775764886.323129:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099854080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1775764886.386981:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764886.579993:0:33136:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764886.580001:0:33136:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764886.580655:0:33136:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764886.580663:0:33136:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764887.229272:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764887.229389:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173696 00000100:00100000:3.0:1775764887.229400:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173696 00000100:00100000:3.0:1775764887.229488:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6675 00000100:00100000:3.0:1775764887.229500:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:50379:x1862023076173696:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1775764887.229602:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+52:50379:x1862023076173696:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 105us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1775764887.229610:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6675 00000100:00080000:0.0:1775764887.229664:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1775764887.232560:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764887.232640:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076173824 00000100:00100000:0.0:1775764887.232650:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076173824 00000100:00100000:0.0:1775764887.232735:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6676 00000100:00100000:0.0:1775764887.232745:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f7289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:50379:x1862023076173824:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764887.232890:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f7289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:50379:x1862023076173824:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 147us (342us total) trans 0 rc -2/-2 00000100:00100000:0.0:1775764887.232900:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6676 00000100:00080000:1.0:1775764887.233222:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1775764887.409931:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764887.551921:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764887.552610:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076174080 00000100:00100000:2.0:1775764887.552622:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076174080 00000100:00100000:2.0:1775764887.552739:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6677 00000100:00100000:2.0:1775764887.552750:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+52:50559:x1862023076174080:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764887.552823:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764887.552847:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5243a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5715 expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.552927:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.552942:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.552955:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553022:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553030:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553037:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553143:0:10681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5243b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553152:0:10681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5243b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553159:0:10681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5243b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764887.553168:0:10681:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1775764887.553237:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553244:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553249:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553255:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cfe00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764887.553259:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553274:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553285:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:2.0:1775764887.553288:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764887.553292:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553299:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed5243ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.553313:0:10681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.554646:0:10681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.554657:0:10681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.554662:0:10681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cf800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764887.554667:0:10681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.554675:0:10681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.554688:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c1c4135b00) 00010000:00010000:2.0:1775764887.554690:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764887.554694:0:10681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.554715:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5243b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.555159:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5243a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5715 expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.555175:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5243b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5715 expref: 54 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764887.555182:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:2.0:1775764887.555184:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764887.555187:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cec00, rc 0) 00000100:00100000:2.0:1775764887.555268:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:50559:x1862023076174080:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 2520us (3357us total) trans 4294970727 rc 0/0 00000100:00100000:2.0:1775764887.555277:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6677 00000100:00100000:0.0:1775764887.565250:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764887.565347:0:24972:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076174336 00000100:00100000:1.0:1775764887.565357:0:24972:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076174336 00000100:00100000:1.0:1775764887.565418:0:24972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1390 00000100:00100000:1.0:1775764887.565428:0:24972:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+54:50559:x1862023076174336:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1775764887.565933:0:24972:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2bb64567-481f-43c2-999a-8c9c071338ae+55:50559:x1862023076174336:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 505us (691us total) trans 4294970728 rc 0/0 00000100:00100000:1.0:1775764887.565942:0:24972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1390 00000100:00100000:1.0:1775764887.574945:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764887.575433:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076174464 00000100:00100000:3.0:1775764887.575453:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076174464 00000100:00100000:3.0:1775764887.575523:0:24971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 763 00000100:00100000:3.0:1775764887.575532:0:24971:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+55:2408:x1862023076174464:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1775764887.575549:0:24971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764887.575572:0:24971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed5243b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5715 expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764887.575611:0:24971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:3.0:1775764887.575616:0:24971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1775764887.575674:0:24971:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:2408:x1862023076174464:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 144us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764887.575681:0:24971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 763 00000100:00100000:0.0:1775764887.601370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764887.602207:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076174592 00000100:00100000:1.0:1775764887.602219:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076174592 00000100:00100000:1.0:1775764887.602285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6678 00000100:00100000:1.0:1775764887.602312:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+54:50559:x1862023076174592:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764887.602442:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+54:50559:x1862023076174592:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 133us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764887.602463:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6678 00000100:00100000:1.0:1775764887.620693:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764887.620815:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076174720 00000100:00100000:2.0:1775764887.620826:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076174720 00000100:00100000:2.0:1775764887.620890:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6679 00000100:00100000:2.0:1775764887.620900:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f728b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:50559:x1862023076174720:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1775764887.621013:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f728b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+15:50559:x1862023076174720:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764887.621022:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6679 00000040:00080000:3.0:1775764887.730005:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764887.730012:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764887.730034:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 2 00000040:00080000:3.0:1775764887.730040:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764887.730184:0:33086:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:33086:1862023099854208:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1775764887.730265:0:33086:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c5655cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764887.736345:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764887.736421:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076174848 00000100:00100000:0.0:1775764887.736431:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076174848 00000100:00100000:0.0:1775764887.736526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6680 00000100:00100000:0.0:1775764887.736536:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:50569:x1862023076174848:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1775764887.736569:0:6522:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1775764887.736675:0:6522:0:(mdt_handler.c:7999:mdt_fid2path()) nonlocal object [0x200000403:0xa2:0x0]: rc = -2 00000100:00100000:0.0:1775764887.736728:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:50569:x1862023076174848:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 193us (393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1775764887.736735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6680 00000100:00100000:3.0:1775764887.737031:0:33086:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:33086:1862023099854208:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764887.740985:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764887.741643:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076175104 00000100:00100000:0.0:1775764887.741656:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076175104 00000100:00100000:0.0:1775764887.741721:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6681 00000100:00100000:0.0:1775764887.741731:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:50569:x1862023076175104:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764887.741754:0:10681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764887.741820:0:10681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd571c expref: -99 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.741981:0:10681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243c7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd571c expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.741999:0:10681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764887.742001:0:10681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1775764887.742008:0:10681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd571c expref: 55 pid: 10681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.742022:0:10681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2d400, rc 0) 00000100:00100000:0.0:1775764887.742087:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:50569:x1862023076175104:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 356us (1113us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764887.742094:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6681 00000100:00100000:1.0:1775764887.754229:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764887.754436:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076175360 00000100:00100000:0.0:1775764887.754446:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076175360 00000100:00100000:0.0:1775764887.754677:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6682 00000100:00100000:0.0:1775764887.754687:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c435ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+54:50569:x1862023076175360:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1775764887.754872:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754889:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754901:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754912:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754918:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754925:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754932:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2d400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764887.754936:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754944:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 4/0,0 mode: PW/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754955:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa2:0x0].0x0 (ffff96c2d660fa00) 00010000:00010000:0.0:1775764887.754958:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1775764887.754970:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 2/0,0 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764887.754977:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d400/0x6e98bd47ed5243ce lrc: 0/0,0 mode: --/PW res: [0x200000403:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1775764887.755293:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764887.755298:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764887.755890:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1775764887.755901:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764887.756395:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c435ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+54:50569:x1862023076175360:12345-192.168.202.58@tcp:57:lhsmtool_posix.0 Request processed in 1701us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764887.756407:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6682 00000040:00080000:0.0:1775764888.303766:0:33281:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764888.304077:0:33281:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764888.304116:0:33281:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 2 00000040:00080000:0.0:1775764888.304125:0:33281:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1775764888.371298:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1775764888.371324:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099854336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764888.371395:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764888.371465:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099854336 00000100:00100000:3.0:1775764888.371473:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099854336 00000100:00100000:3.0:1775764888.371519:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1775764888.371530:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099854336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1775764888.371564:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444212736 avail 1297973248 00000100:00100000:3.0:1775764888.371613:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099854336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764888.371621:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1775764888.371668:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099854336:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1775764888.374406:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970728 is committed 00000004:00080000:0.0:1775764888.374425:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00000001:00080000:0.0:1775764888.374490:0:6499:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294970726 is committed 00000004:00080000:0.0:1775764888.374493:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000100:00100000:3.0:1775764888.374656:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1775764888.374671:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764888.374677:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099854464:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1775764888.374685:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764888.374693:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764888.374700:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764888.374704:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764888.374711:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764888.374741:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x18:0x0].0xf410cd0b (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764888.374744:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764888.374750:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764888.374757:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f800/0x6e98bd47ed52438f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x18:0x0].0xf410cd0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764888.374765:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764888.374843:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099854464 00000100:00100000:3.0:1775764888.374851:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099854464 00000100:00100000:3.0:1775764888.374917:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00080000:0.0:1775764888.374922:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764888.374926:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099854464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1775764888.374953:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:88 count 1 00010000:00010000:3.0:1775764888.374975:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764888.374995:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 6 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764888.375006:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764888.375013:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764888.375015:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764888.375018:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764888.375045:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764888.375057:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 8 pid: 8405 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764888.375082:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099854592:192.168.202.58@tcp:104: 00010000:00010000:3.0:1775764888.375164:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 6 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764888.375173:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 6 pid: 15167 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764888.375183:0:8405:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099854720:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764888.375206:0:8405:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c56553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1775764888.388372:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764888.388400:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764888.388441:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076175488 00000100:00100000:1.0:1775764888.388450:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076175488 00010000:00010000:1.0:1775764888.388509:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 9 pid: 8405 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764888.388593:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076175616 00000100:00100000:1.0:1775764888.388597:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076175616 00010000:00010000:1.0:1775764888.388615:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 7 pid: 15167 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764888.388638:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1445 00000100:00100000:1.0:1775764888.388646:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076175488:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764888.388663:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764888.388682:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 9 pid: 8405 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.388695:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 9 pid: 8405 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.388723:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764888.388825:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+9:2408:x1862023076175488:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 178us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764888.388833:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1445 00000100:00100000:1.0:1775764888.388853:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1446 00000100:00100000:1.0:1775764888.388860:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076175616:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1775764888.388868:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1775764888.388873:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 7 pid: 15167 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.388883:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 7 pid: 15167 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.388898:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764888.388900:0:25200:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1775764888.388906:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.388917:0:25200:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.388948:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1775764888.388968:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+7:2408:x1862023076175616:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 109us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764888.388975:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1446 00000100:00080000:1.0:1775764888.388994:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1775764888.389393:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a741880b/0x6e98bd47ed524381 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd570e expref: 8 pid: 8405 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764888.389409:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099854592:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764888.389433:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539af354/0x6e98bd47ed524349 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd56f9 expref: 6 pid: 15167 timeout: 1496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764888.389442:0:8405:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1862023099854720:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764888.389467:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764888.389476:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764888.389483:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764888.389492:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764888.389499:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764888.389523:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1775764888.389705:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099854464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14779us (14945us total) trans 4294967732 rc 0/0 00000100:00100000:2.0:1775764888.389713:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000004:00080000:2.0:1775764888.389797:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96c301e41f80/2, rc 0, transno 4294967732 00000100:00100000:2.0:1775764888.389813:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099854464:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1775764888.390292:0:6509:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1775764888.390301:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.390310:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1000 already unused, calling callback (ffffffffc0c9b060) 00010000:00010000:1.0:1775764888.390315:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.390326:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.390347:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.390354:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006756acc3/0x6e98bd47ed5243d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764888.390375:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764888.390377:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764888.390379:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1775764888.434170:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1775764888.626130:0:33136:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764888.626159:0:33136:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764888.626693:0:33136:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1775764888.626704:0:33136:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1775764889.393938:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764889.393969:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099854848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1775764889.394043:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764889.394120:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099854848 00000100:00100000:0.0:1775764889.394128:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099854848 00000100:00100000:0.0:1775764889.394179:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1775764889.394199:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099854848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1775764889.394232:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50786496 pending 0 free 3916955648 avail 3685433344 00000100:00100000:0.0:1775764889.394278:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1862023099854848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764889.394286:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1775764889.394333:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099854848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764889.395437:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1775764889.395453:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099854976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1775764889.395498:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764889.395544:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099854976 00000100:00100000:3.0:1775764889.395549:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099854976 00000100:00100000:3.0:1775764889.395595:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1775764889.395602:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099854976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1775764889.395618:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50786496 pending 0 free 3916955648 avail 3685433344 00000100:00100000:3.0:1775764889.395658:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1862023099854976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764889.395664:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:3.0:1775764889.395682:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1775764889.395709:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3663:1862023099854976:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1775764889.457981:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764890.418870:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099855104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1775764890.418957:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764890.419269:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855104 00000100:00100000:1.0:1775764890.419278:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855104 00000100:00100000:1.0:1775764890.419332:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1775764890.419342:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099855104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1775764890.419384:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1775764890.419441:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099855104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764890.419448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1775764890.419630:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099855104:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1775764890.482415:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764890.762165:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762206:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762277:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762319:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762340:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762357:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762384:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764890.762412:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176000 00000100:00100000:3.0:1775764890.762422:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176000 00000100:00100000:3.0:1775764890.762483:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176512 00000100:00100000:3.0:1775764890.762486:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176512 00000100:00100000:3.0:1775764890.762519:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076175872 00000100:00100000:3.0:1775764890.762523:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076175872 00000100:00100000:3.0:1775764890.762543:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176384 00000100:00100000:3.0:1775764890.762546:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176384 00000100:00100000:3.0:1775764890.762565:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2053 00000100:00100000:3.0:1775764890.762575:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076176000:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.762661:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+15:2408:x1862023076176000:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 88us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.762670:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2053 00000100:00100000:3.0:1775764890.762689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2054 00000100:00100000:3.0:1775764890.762696:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076176512:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.762722:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2408:x1862023076176512:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.762746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2054 00000100:00100000:3.0:1775764890.762759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2055 00000100:00100000:3.0:1775764890.762765:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+52:2408:x1862023076175872:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.762838:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+52:2408:x1862023076175872:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.762845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2055 00000100:00100000:3.0:1775764890.762857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2056 00000100:00100000:3.0:1775764890.762864:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:2408:x1862023076176384:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.762885:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:2408:x1862023076176384:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 22us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.762891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2056 00000100:00100000:3.0:1775764890.762915:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176256 00000100:00100000:3.0:1775764890.762919:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176256 00000100:00100000:3.0:1775764890.762944:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176768 00000100:00100000:3.0:1775764890.762947:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176768 00000100:00100000:3.0:1775764890.762962:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176128 00000100:00100000:3.0:1775764890.762965:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176128 00000100:00100000:3.0:1775764890.762976:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176640 00000100:00100000:3.0:1775764890.762978:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176640 00000100:00100000:3.0:1775764890.762991:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1503 00000100:00100000:3.0:1775764890.762996:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2408:x1862023076176256:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.763021:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+8:2408:x1862023076176256:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 25us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.763027:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1503 00000100:00100000:3.0:1775764890.763038:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1504 00000100:00100000:3.0:1775764890.763053:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c301e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2408:x1862023076176768:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.763081:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c301e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2408:x1862023076176768:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.763087:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1504 00000100:00100000:3.0:1775764890.763099:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1505 00000100:00100000:3.0:1775764890.763104:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076176128:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.763127:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+6:2408:x1862023076176128:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 23us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.763134:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1505 00000100:00100000:3.0:1775764890.763144:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1506 00000100:00100000:3.0:1775764890.763150:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076176640:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764890.763170:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2408:x1862023076176640:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 21us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.763177:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1506 00000100:00080000:3.0:1775764890.763192:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1775764890.763196:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764890.763199:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764890.763200:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764890.764826:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076175744 00000100:00100000:1.0:1775764890.764838:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076175744 00000100:00100000:1.0:1775764890.764904:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 995 00000100:00100000:1.0:1775764890.764915:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076175744:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764890.765173:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2408:x1862023076175744:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 259us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764890.765181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 995 00000100:00100000:2.0:1775764890.930013:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099855488:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.930083:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764890.930126:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099856000:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.930150:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764890.930166:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099856512:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930268:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099855616:0@lo:400:kworker.0 00000100:00100000:0.0:1775764890.930293:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099855232:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930300:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764890.930325:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764890.930325:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099856128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930345:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764890.930346:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099855744:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930357:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099856640:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930374:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764890.930378:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764890.930394:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099856256:0@lo:400:kworker.0 00000100:00100000:0.0:1775764890.930411:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764890.930412:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099855360:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930435:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764890.930450:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099855872:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930468:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764890.930480:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764890.930503:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099856384:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.930511:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856000 00000100:00100000:2.0:1775764890.930517:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856000 00000100:00100000:3.0:1775764890.930524:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764890.930553:0:6526:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855488 00000100:00100000:2.0:1775764890.930555:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856128 00000100:00100000:2.0:1775764890.930557:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856128 00000100:00100000:3.0:1775764890.930557:0:6526:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855488 00000100:00100000:2.0:1775764890.930579:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856640 00000100:00100000:2.0:1775764890.930581:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856640 00000100:00100000:3.0:1775764890.930583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:3.0:1775764890.930590:0:6526:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099855488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.930641:0:6526:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099855488:12345-0@lo:400:kworker.0 Request processed in 50us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.930649:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1775764890.931648:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856512 00000100:00100000:2.0:1775764890.931658:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856512 00000100:00100000:2.0:1775764890.931697:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1775764890.931705:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099856000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.931763:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099856000:12345-0@lo:400:kworker.0 Request processed in 59us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764890.931793:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1775764890.931808:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1775764890.931815:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099856128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764890.931877:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855616 00000100:00100000:0.0:1775764890.931881:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855616 00000100:00100000:0.0:1775764890.931910:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855744 00000100:00100000:0.0:1775764890.931913:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855744 00000100:00100000:0.0:1775764890.931926:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856256 00000100:00100000:0.0:1775764890.931929:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856256 00000100:00100000:0.0:1775764890.931940:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855360 00000100:00100000:0.0:1775764890.931943:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855360 00000100:00100000:0.0:1775764890.931958:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855872 00000100:00100000:0.0:1775764890.931960:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855872 00000100:00100000:0.0:1775764890.931974:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856384 00000100:00100000:0.0:1775764890.931977:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856384 00000100:00100000:0.0:1775764890.931990:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1775764890.931995:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099855616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.935275:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3661:x1862023099856128:12345-0@lo:400:kworker.0 Request processed in 3449us (4917us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764890.935290:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1775764890.935347:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1775764890.935361:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099856640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764890.938533:0:6515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099855232 00000100:00100000:1.0:1775764890.938547:0:6515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099855232 00000100:00100000:1.0:1775764890.938610:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1775764890.938619:0:6515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099855232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764890.938726:0:6515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3662:x1862023099855232:12345-0@lo:400:kworker.0 Request processed in 109us (8400us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764890.938733:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1775764890.938836:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3662:1862023099855232:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939245:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1775764890.939257:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099855744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939303:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1862023099855744:12345-0@lo:400:kworker.0 Request processed in 50us (8922us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.939309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1775764890.939327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1775764890.939332:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099856256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939358:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1862023099856256:12345-0@lo:400:kworker.0 Request processed in 26us (8947us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.939362:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1775764890.939372:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1775764890.939377:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099855360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939415:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1862023099855360:12345-0@lo:400:kworker.0 Request processed in 38us (8980us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.939420:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1775764890.939431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:3.0:1775764890.939436:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099855872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939456:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1862023099855872:12345-0@lo:400:kworker.0 Request processed in 22us (8988us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.939461:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:3.0:1775764890.939469:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1775764890.939474:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099856384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939494:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1862023099856384:12345-0@lo:400:kworker.0 Request processed in 21us (8969us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.939499:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1775764890.939519:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1775764890.939526:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099856512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.939553:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1862023099856512:12345-0@lo:400:kworker.0 Request processed in 29us (9073us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764890.939559:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00080000:3.0:1775764890.939594:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1775764890.939599:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1775764890.939607:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1775764890.939610:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1775764890.939766:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1862023099855616:12345-0@lo:400:kworker.0 Request processed in 7769us (9464us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764890.939797:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1775764890.940186:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3662:1862023099855744:0@lo:400:kworker.0 00000100:00100000:1.0:1775764890.940199:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3662:1862023099856256:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.941703:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099856640:12345-0@lo:400:kworker.0 Request processed in 6340us (11320us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764890.941717:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1775764890.941847:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099855488:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.941859:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099856000:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.941869:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099856512:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.941913:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3663:1862023099855360:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.941923:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3663:1862023099855872:0@lo:400:kworker.0 00000100:00100000:2.0:1775764890.941933:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3663:1862023099856384:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.950237:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3661:1862023099855616:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.950258:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099856128:0@lo:400:kworker.0 00000100:00100000:3.0:1775764890.950269:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099856640:0@lo:400:kworker.0 00000100:00100000:2.0:1775764891.442027:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099856768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764891.442096:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764891.442230:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856768 00000100:00100000:0.0:1775764891.442239:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856768 00000100:00100000:0.0:1775764891.442294:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1775764891.442302:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099856768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1775764891.442330:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:0.0:1775764891.442379:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099856768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764891.442386:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1775764891.442493:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099856768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1775764891.442934:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1775764891.442956:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099856896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1775764891.442983:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764891.443187:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099856896 00000100:00100000:1.0:1775764891.443192:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099856896 00000100:00100000:1.0:1775764891.443228:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1775764891.443234:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099856896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1775764891.443249:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:1.0:1775764891.443289:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1862023099856896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764891.443294:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1775764891.443468:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3664:1862023099856896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1775764891.506061:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1775764892.530041:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1775764893.210856:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764893.210971:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076176896 00000100:00100000:0.0:1775764893.210985:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076176896 00000100:00100000:0.0:1775764893.211074:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6683 00000100:00100000:0.0:1775764893.211086:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+52:50559:x1862023076176896:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1775764893.211207:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+52:50559:x1862023076176896:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764893.211215:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6683 00000100:00080000:3.0:1775764893.211426:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1775764893.223989:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764893.224735:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177024 00000100:00100000:3.0:1775764893.224749:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177024 00000100:00100000:3.0:1775764893.224987:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6684 00000100:00100000:3.0:1775764893.224999:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:50559:x1862023076177024:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1775764893.225972:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+15:50559:x1862023076177024:12345-192.168.202.58@tcp:60:lhsmtool_posix.0 Request processed in 969us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764893.225983:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6684 00000100:00080000:0.0:1775764893.227657:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764893.494194:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c4d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099857024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1775764893.494267:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764893.494377:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857024 00000100:00100000:1.0:1775764893.494386:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857024 00000100:00100000:1.0:1775764893.494440:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1775764893.494449:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099857024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1775764893.494486:0:7711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6963200 pending 0 free 1444212736 avail 1297973248 00000100:00100000:1.0:1775764893.498017:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1862023099857024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3562us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764893.498032:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1775764893.498440:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c4d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3664:1862023099857024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1775764893.553901:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1775764894.009876:0:8398:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967732 is committed 00000100:00100000:3.0:1775764894.523568:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099857152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1775764894.523638:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764894.523701:0:10037:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857152 00000100:00100000:3.0:1775764894.523709:0:10037:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857152 00000100:00100000:3.0:1775764894.523768:0:10037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1775764894.523817:0:10037:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f9937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099857152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1775764894.523843:0:10037:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50786496 pending 0 free 3916955648 avail 3685433344 00000100:00100000:3.0:1775764894.523881:0:10037:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f9937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1862023099857152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764894.523888:0:10037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1775764894.523921:0:3661:0:(client.c:3082:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967732 gen 2 00000004:00080000:3.0:1775764894.523925:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96c301e41f80, transno 4294967732 00000100:00100000:3.0:1775764894.523948:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3661:1862023099857152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1775764894.524107:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099857280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1775764894.524131:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764894.524159:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857280 00000100:00100000:2.0:1775764894.524162:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857280 00000100:00100000:2.0:1775764894.524192:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1775764894.524201:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099857280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1775764894.524220:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50786496 pending 0 free 3916955648 avail 3685433344 00000100:00100000:2.0:1775764894.524253:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099857280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764894.524260:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1775764894.524290:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099857280:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1775764894.524334:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1775764894.577940:0:9477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1775764895.538182:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c5107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1775764895.538265:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764895.539701:0:6527:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857408 00000100:00100000:2.0:1775764895.539712:0:6527:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857408 00000100:00100000:2.0:1775764895.539805:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1775764895.539815:0:6527:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099857408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1775764895.539856:0:6527:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446219776 avail 1299980288 00000100:00100000:2.0:1775764895.539924:0:6527:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099857408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764895.539931:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1775764895.541176:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c5107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099857408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1775764895.602376:0:6509:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1775764895.876761:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764895.876854:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764895.876953:0:6516:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177152 00000100:00100000:1.0:1775764895.876964:0:6516:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177152 00000100:00100000:1.0:1775764895.877040:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 997 00000100:00100000:1.0:1775764895.877051:0:6516:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076177152:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764895.877130:0:6516:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bc78d45-5379-4d62-8e28-79875d287077+12:2411:x1862023076177152:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 80us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764895.877153:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 997 00000100:00100000:2.0:1775764895.877355:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764895.877386:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764895.877749:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177664 00000100:00100000:1.0:1775764895.877755:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177664 00000100:00100000:1.0:1775764895.877838:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1511 00000100:00100000:1.0:1775764895.877847:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076177664:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764895.877888:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2bb64567-481f-43c2-999a-8c9c071338ae+8:2411:x1862023076177664:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 42us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764895.877896:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1511 00000100:00080000:0.0:1775764895.878198:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764895.878999:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764895.879045:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764895.879143:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076178176 00000100:00100000:1.0:1775764895.879152:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076178176 00000100:00100000:1.0:1775764895.879208:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1512 00000100:00100000:1.0:1775764895.879217:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076178176:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764895.879284:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2411:x1862023076178176:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764895.879291:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1512 00000100:00080000:1.0:1775764895.879389:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1775764895.879972:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177408 00000100:00100000:3.0:1775764895.879980:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177408 00000100:00100000:2.0:1775764895.880174:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764895.880201:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764895.880225:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764895.880249:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177920 00000100:00100000:2.0:1775764895.880254:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177920 00000100:00100000:3.0:1775764895.880309:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2063 00000100:00100000:3.0:1775764895.880318:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c5107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076177408:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764895.880372:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c5107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+15:2411:x1862023076177408:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 55us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764895.880379:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2063 00000100:00100000:3.0:1775764895.880393:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177280 00000100:00100000:3.0:1775764895.880396:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177280 00000100:00100000:0.0:1775764895.880439:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177792 00000100:00100000:0.0:1775764895.880444:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177792 00000100:00080000:1.0:1775764895.880485:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1775764895.880489:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1775764895.880610:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076177536 00000100:00100000:1.0:1775764895.880614:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076177536 00000100:00100000:1.0:1775764895.880642:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076178048 00000100:00100000:1.0:1775764895.880645:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076178048 00000100:00100000:1.0:1775764895.880664:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1513 00000100:00100000:1.0:1775764895.880670:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076177536:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764895.880702:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+6:2411:x1862023076177536:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764895.880746:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1513 00000100:00100000:1.0:1775764895.880760:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1514 00000100:00100000:1.0:1775764895.880767:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076178048:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:1.0:1775764895.880814:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+8:2411:x1862023076178048:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 48us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764895.880821:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1514 00000100:00080000:1.0:1775764895.880888:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764895.881380:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2064 00000100:00100000:2.0:1775764895.881389:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2f66d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076177920:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:2.0:1775764895.881438:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2f66d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+6:2411:x1862023076177920:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 50us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764895.881445:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2064 00000100:00100000:3.0:1775764895.882187:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2065 00000100:00100000:3.0:1775764895.882198:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:2411:x1862023076177280:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:3.0:1775764895.882240:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:2411:x1862023076177280:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 44us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764895.882247:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2065 00000100:00100000:0.0:1775764895.882398:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 2066 00000100:00100000:0.0:1775764895.882405:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:2411:x1862023076177792:12345-192.168.202.58@tcp:400:kworker.0 00000100:00100000:0.0:1775764895.882443:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:2411:x1862023076177792:12345-192.168.202.58@tcp:400:kworker.0 Request processed in 38us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764895.882450:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 2066 00000040:00080000:3.0:1775764895.986032:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1775764895.986043:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1775764895.986071:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 2 00000040:00080000:3.0:1775764895.986081:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764896.050331:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099857536:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.050334:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099857664:0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.050411:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099857920:0@lo:400:kworker.0 00000100:00100000:3.0:1775764896.053235:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f9934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099857792:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.059381:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764896.059448:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099858048:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.059484:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764896.059505:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099858560:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.059527:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764896.059579:0:6514:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857536 00000100:00100000:1.0:1775764896.059586:0:6514:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857536 00000100:00100000:1.0:1775764896.059631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1775764896.059640:0:6514:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d0b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.059691:0:6514:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d0b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5bb8ea34-6689-4fa2-84d5-c41770c129e7+23:3664:x1862023099857536:12345-0@lo:400:kworker.0 Request processed in 52us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764896.059698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1775764896.059757:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858048 00000100:00100000:1.0:1775764896.059761:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858048 00000100:00100000:1.0:1775764896.059815:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858560 00000100:00100000:1.0:1775764896.059819:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858560 00000100:00100000:1.0:1775764896.059843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1775764896.059866:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099858048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.059910:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1862023099858048:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764896.059919:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764896.059923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1775764896.059940:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857920 00000100:00100000:1.0:1775764896.059943:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857920 00000100:00100000:0.0:1775764896.059949:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099858432:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.059968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:1.0:1775764896.059975:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099858560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.059990:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764896.060017:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1862023099858560:12345-0@lo:400:kworker.0 Request processed in 42us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764896.060019:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099858944:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.060030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:1.0:1775764896.060045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1775764896.060050:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1775764896.060054:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099857920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.060088:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858432 00000100:00100000:0.0:1775764896.060092:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858432 00000100:00100000:1.0:1775764896.060096:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1862023099857920:12345-0@lo:400:kworker.0 Request processed in 44us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764896.060103:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1775764896.060123:0:15167:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858944 00000100:00100000:0.0:1775764896.060126:0:15167:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858944 00000100:00080000:1.0:1775764896.060137:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764896.060142:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1775764896.060146:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764896.060154:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1775764896.060163:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099858432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.060195:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099858432:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764896.060201:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1775764896.060227:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1775764896.060234:0:15167:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099858944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.060260:0:15167:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099858944:12345-0@lo:400:kworker.0 Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764896.060265:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1775764896.060304:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3663:1862023099857920:0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.060313:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099858432:0@lo:400:kworker.0 00000100:00100000:0.0:1775764896.060321:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099858944:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.063147:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764896.063202:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099858176:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.063238:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764896.063259:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099858688:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.063271:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764896.063310:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857664 00000100:00100000:2.0:1775764896.063316:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857664 00000100:00100000:2.0:1775764896.063346:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858176 00000100:00100000:2.0:1775764896.063348:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858176 00000100:00100000:2.0:1775764896.063364:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858688 00000100:00100000:2.0:1775764896.063365:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858688 00000100:00100000:2.0:1775764896.063378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1775764896.063383:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099857664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.063421:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1862023099857664:12345-0@lo:400:kworker.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764896.063425:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1775764896.063437:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:2.0:1775764896.063441:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.063458:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1862023099858176:12345-0@lo:400:kworker.0 Request processed in 18us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764896.063462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1775764896.063469:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5bb8ea34-6689-4fa2-84d5-c41770c129e7:3664:1862023099857536:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.063489:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:2.0:1775764896.063494:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099858688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.063525:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c301e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3664:1862023099858048:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.063539:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3664:1862023099858560:0@lo:400:kworker.0 00000100:00080000:1.0:1775764896.063576:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764896.063865:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764896.063895:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099858304:0@lo:400:kworker.0 00000100:00100000:3.0:1775764896.063921:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764896.063950:0:3662:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099858816:0@lo:400:kworker.0 00000100:00100000:3.0:1775764896.063980:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1775764896.064016:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858304 00000100:00100000:3.0:1775764896.064021:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858304 00000100:00100000:3.0:1775764896.064058:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099858816 00000100:00100000:3.0:1775764896.064061:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099858816 00000100:00100000:3.0:1775764896.064082:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:1.0:1775764896.064329:0:7711:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099857792 00000100:00100000:1.0:1775764896.064335:0:7711:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099857792 00000100:00100000:1.0:1775764896.064369:0:7711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1775764896.064385:0:7711:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.064438:0:7711:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1862023099857792:12345-0@lo:400:kworker.0 Request processed in 55us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764896.064445:0:7711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1775764896.065393:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1862023099858688:12345-0@lo:400:kworker.0 Request processed in 1893us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764896.065401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:2.0:1775764896.065451:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3661:1862023099857664:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.065463:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3661:1862023099858176:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.065471:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3661:1862023099858688:0@lo:400:kworker.0 00000100:00100000:2.0:1775764896.065520:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f9934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099857792:0@lo:400:kworker.0 00000100:00100000:3.0:1775764896.065585:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099858304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764896.065636:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099858304:12345-0@lo:400:kworker.0 Request processed in 57us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764896.072162:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1775764896.072200:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099858816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1775764896.072205:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1775764896.072301:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099858304:0@lo:400:kworker.0 00000100:00100000:1.0:1775764896.072310:0:8402:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1862023099858816:12345-0@lo:400:kworker.0 Request processed in 126us (8327us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764896.072318:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:3.0:1775764896.072322:0:3662:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3662:1862023099858816:0@lo:400:kworker.0 00000100:00080000:1.0:1775764896.072378:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1775764896.072384:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1775764896.561917:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1775764896.561940:0:3663:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2fe1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099859072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764896.562007:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1775764896.562074:0:8407:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099859072 00000100:00100000:2.0:1775764896.562082:0:8407:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099859072 00000100:00100000:2.0:1775764896.562136:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1775764896.562145:0:8407:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099859072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1775764896.562174:0:8407:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:2.0:1775764896.562216:0:8407:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1862023099859072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764896.562223:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1775764896.562267:0:3663:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2fe1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3663:1862023099859072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1775764896.562475:0:3661:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099859200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1775764896.562501:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1775764896.562559:0:8406:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023099859200 00000100:00100000:0.0:1775764896.562564:0:8406:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023099859200 00000100:00100000:0.0:1775764896.562595:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1775764896.562602:0:8406:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099859200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1775764896.562614:0:8406:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 510161088 pending 0 free 3886534656 avail 3655012352 00000100:00100000:0.0:1775764896.562657:0:8406:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1862023099859200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764896.562663:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1775764896.562905:0:3661:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3661:1862023099859200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1775764896.626485:0:6508:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1775764896.720703:0:33574:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 16:01:35 (1775764895) 00000040:00080000:0.0:1775764896.819919:0:33136:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764896.819929:0:33136:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764896.820488:0:33136:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764896.820498:0:33136:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1775764896.990530:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764896.992429:0:10088:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076178432 00000100:00100000:0.0:1775764896.992443:0:10088:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076178432 00000100:00100000:0.0:1775764896.992512:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6685 00000100:00100000:0.0:1775764896.992522:0:10088:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+52:51207:x1862023076178432:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1775764896.992542:0:10088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764896.992562:0:10088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d000/0x6e98bd47ed5243dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5723 expref: -99 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992631:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992647:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992660:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992675:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992683:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992689:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992848:0:10088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5243f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992858:0:10088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5243f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992865:0:10088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5243f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1775764896.992874:0:10088:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1775764896.992962:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992970:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992977:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992983:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2c000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764896.992987:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.992995:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993007:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96c2f701f900) 00010000:00010000:0.0:1775764896.993010:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764896.993014:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993031:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed5243e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993045:0:10088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993051:0:10088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993058:0:10088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993062:0:10088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2c600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764896.993065:0:10088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993071:0:10088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993079:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96c2c894cf00) 00010000:00010000:0.0:1775764896.993081:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764896.993084:0:10088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993090:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5243ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993414:0:10088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d000/0x6e98bd47ed5243dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5723 expref: 55 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993441:0:10088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5243f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5723 expref: 54 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764896.993449:0:10088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764896.993452:0:10088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764896.993455:0:10088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2cc00, rc 0) 00000100:00100000:0.0:1775764896.993521:0:10088:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2bb64567-481f-43c2-999a-8c9c071338ae+54:51207:x1862023076178432:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 1001us (3001us total) trans 4294970729 rc 0/0 00000100:00100000:0.0:1775764896.993529:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6685 00000100:00100000:0.0:1775764897.002105:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764897.003127:0:6525:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076178688 00000100:00100000:3.0:1775764897.003150:0:6525:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076178688 00000100:00100000:3.0:1775764897.003267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1391 00000100:00100000:3.0:1775764897.003277:0:6525:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2df700c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:51207:x1862023076178688:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1775764897.003730:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1775764897.003904:0:6525:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2df700c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:51207:x1862023076178688:12345-192.168.202.58@tcp:35:lhsmtool_posix.0 Request processed in 627us (2152us total) trans 4294970730 rc 0/0 00000100:00100000:3.0:1775764897.003914:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1391 00000100:00100000:2.0:1775764897.004203:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764897.004392:0:24971:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076178816 00000100:00100000:3.0:1775764897.004400:0:24971:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076178816 00000100:00100000:0.0:1775764897.004625:0:25199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 764 00000100:00100000:0.0:1775764897.004638:0:25199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:2409:x1862023076178816:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764897.004653:0:25199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764897.004686:0:25199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5243f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5723 expref: 55 pid: 10088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.004707:0:25199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96c1c2b84500) 00010000:00010000:0.0:1775764897.004712:0:25199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764897.004756:0:25199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2bb64567-481f-43c2-999a-8c9c071338ae+54:2409:x1862023076178816:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 122us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764897.004807:0:25199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 764 00000100:00100000:2.0:1775764897.007886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.007973:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.008093:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076178944 00000100:00100000:1.0:1775764897.008103:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076178944 00000100:00100000:1.0:1775764897.008339:0:10681:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179072 00000100:00100000:1.0:1775764897.008342:0:10681:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179072 00000100:00080000:2.0:1775764897.008383:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1775764897.013599:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6686 00000100:00100000:1.0:1775764897.013962:0:10681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6687 00000100:00100000:0.0:1775764897.013963:0:6523:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:51208:x1862023076178944:12345-192.168.202.58@tcp:101:lfs.0 00000100:00100000:1.0:1775764897.013993:0:10681:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:51207:x1862023076179072:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00010000:00010000:0.0:1775764897.013995:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764897.014070:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d000/0x6e98bd47ed5243ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd572a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014140:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014155:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764897.014162:0:10681:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2bb64567-481f-43c2-999a-8c9c071338ae+54:51207:x1862023076179072:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 181us (6184us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764897.014188:0:10681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6687 00010000:00010000:0.0:1775764897.014194:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014238:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014246:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014254:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014301:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014309:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014315:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014322:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014328:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2c600 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764897.014341:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014348:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014363:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764897.014367:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764897.014371:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014378:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed524406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014398:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014416:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014422:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014427:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2c000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764897.014430:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014436:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014443:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb3ca0e89 (ffff96c2c894cf00) 00010000:00010000:0.0:1775764897.014445:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764897.014455:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014461:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c000/0x6e98bd47ed52440d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1775764897.014487:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764897.014492:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1775764897.014497:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d000/0x6e98bd47ed5243ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd572a expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.014510:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:0.0:1775764897.014513:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764897.014518:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2d000/0x6e98bd47ed5243ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd572a expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1775764897.014520:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 159 count 2 00000040:00080000:1.0:1775764897.014534:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1775764897.014542:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2d000, rc 0) 00000100:00100000:0.0:1775764897.014635:0:6523:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:51208:x1862023076178944:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 696us (6760us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764897.014646:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6686 00000100:00100000:2.0:1775764897.018255:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.018337:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179200 00000100:00100000:1.0:1775764897.018366:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179200 00000100:00100000:1.0:1775764897.018443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6688 00000100:00100000:1.0:1775764897.018452:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:51207:x1862023076179200:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1775764897.018568:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+15:51207:x1862023076179200:12345-192.168.202.58@tcp:59:lhsmtool_posix.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764897.018574:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6688 00000100:00100000:1.0:1775764897.019324:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00080000:2.0:1775764897.019364:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1775764897.019403:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179456 00000100:00100000:3.0:1775764897.019410:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179456 00000100:00100000:3.0:1775764897.019464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6689 00000100:00100000:3.0:1775764897.019471:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+42:51208:x1862023076179456:12345-192.168.202.58@tcp:36:lfs.0 00010000:00010000:3.0:1775764897.019520:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1775764897.019550:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c3f6d200/0x6e98bd47ed52420e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5682 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.019567:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764897.019572:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1775764897.019637:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.019648:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.019654:0:6522:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.019686:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.019696:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 53 pid: 6522 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764897.019709:0:6522:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c7445500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099859328:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764897.019909:0:6522:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c36d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1775764897.023280:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.023361:0:25200:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179584 00000100:00100000:2.0:1775764897.023373:0:25200:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179584 00000100:00100000:1.0:1775764897.023392:0:6522:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c7445500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1862023099859328:192.168.202.58@tcp:104: 00010000:00010000:2.0:1775764897.023419:0:25200:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 54 pid: 6522 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.023425:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764897.023519:0:25200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1447 00000100:00100000:2.0:1775764897.023531:0:25200:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+54:2410:x1862023076179584:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1775764897.023551:0:25200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1775764897.023559:0:25200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 54 pid: 6522 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.023573:0:25200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 54 pid: 6522 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.023600:0:25200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f600/0x6e98bd47ed52424d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5697 expref: 54 pid: 6522 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.023618:0:25200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764897.023622:0:25200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.023653:0:25200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.023662:0:25200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.023696:0:25200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1775764897.023758:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.023794:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.023824:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed52441b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.023833:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed52441b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.023840:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed52441b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1775764897.024013:0:25200:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2bb64567-481f-43c2-999a-8c9c071338ae+53:2410:x1862023076179584:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 483us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764897.024033:0:25200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1447 00010000:00010000:1.0:1775764897.024709:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed524422 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.024730:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed524422 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.024746:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed524422 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764897.025101:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008aeabeee reply state 00000000b2acb0c4 transno 4294970731 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed524422 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025113:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ec00/0x6e98bd47ed524422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025119:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:1.0:1775764897.025121:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764897.025124:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1775764897.025130:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 4096 00010000:00010000:1.0:1775764897.025138:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025145:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025151:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025158:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025164:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1800 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764897.025169:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025177:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025200:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764897.025202:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764897.025205:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025209:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1800/0x6e98bd47ed524414 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764897.025218:0:6522:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008aeabeee reply state 00000000b2acb0c4 transno 4294970731 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed52441b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025224:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e400/0x6e98bd47ed52441b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.025228:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb3ca0e89 (ffff96c2c7e0f300) 00010000:00010000:1.0:1775764897.025229:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764897.025231:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1775764897.025320:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:51208:x1862023076179456:12345-192.168.202.58@tcp:36:lfs.0 Request processed in 5847us (5997us total) trans 4294970731 rc 0/0 00000100:00100000:1.0:1775764897.025328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6689 00000100:00100000:3.0:1775764897.033665:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.033956:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179712 00000100:00100000:2.0:1775764897.033970:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179712 00000100:00100000:2.0:1775764897.034045:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6690 00000100:00100000:2.0:1775764897.034057:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c7445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+43:51209:x1862023076179712:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:2.0:1775764897.034091:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764897.034118:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed524429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5731 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.034210:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed524430 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.034224:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed524430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.034234:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed524430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764897.034294:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1775764897.034296:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764897.034335:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed524430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.034357:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed524429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5731 expref: 45 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.034372:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cec00/0x6e98bd47ed524430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5731 expref: 44 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.034378:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764897.034380:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1775764897.034383:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cec00, rc 0) 00000100:00100000:2.0:1775764897.034445:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c7445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:51209:x1862023076179712:12345-192.168.202.58@tcp:101:bash.0 Request processed in 391us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764897.034452:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6690 00000100:00100000:2.0:1775764897.037519:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764897.037626:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179840 00000100:00100000:3.0:1775764897.037640:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179840 00000100:00100000:3.0:1775764897.037712:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6691 00000100:00100000:3.0:1775764897.037753:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2fe1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+44:51209:x1862023076179840:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:3.0:1775764897.037938:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764897.037965:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed524437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5738 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038043:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038061:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038074:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038087:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038095:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038101:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038207:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed52444c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038216:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed52444c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038223:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed52444c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1775764897.038282:0:24980:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 4096 00000004:00200000:3.0:1775764897.038287:0:24980:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1775764897.038313:0:24980:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed52444c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038327:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038333:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038339:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038347:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038353:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764897.038358:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038366:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038380:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:3.0:1775764897.038384:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764897.038390:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038397:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed52443e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038423:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038430:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038436:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038441:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764897.038444:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038450:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038459:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb3ca0e89 (ffff96c2c7e0f300) 00010000:00010000:3.0:1775764897.038461:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764897.038465:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038471:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524445 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038497:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed524437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5738 expref: 46 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038510:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0c00/0x6e98bd47ed52444c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5738 expref: 45 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.038528:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:3.0:1775764897.038531:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1775764897.038533:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0c00, rc 0) 00000100:00100000:3.0:1775764897.038736:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2fe1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:51209:x1862023076179840:12345-192.168.202.58@tcp:101:bash.0 Request processed in 985us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764897.038745:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6691 00000100:00100000:2.0:1775764897.043600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.044914:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076179968 00000100:00100000:2.0:1775764897.044930:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076179968 00000100:00100000:2.0:1775764897.045011:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6692 00000100:00100000:2.0:1775764897.045031:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:51209:x1862023076179968:12345-192.168.202.58@tcp:101:bash.0 00010000:00010000:2.0:1775764897.045059:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764897.045085:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed524453 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd573f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045182:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045235:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045264:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045272:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045279:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045333:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045340:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045344:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045348:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045352:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cfc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.045355:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045361:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045372:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:2.0:1775764897.045379:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.045384:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 3/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045389:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52445a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045399:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045403:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045407:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045410:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cfe00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.045411:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045414:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045418:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764897.045419:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.045421:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045424:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524461 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045462:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed524453 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd573f expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045481:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:2.0:1775764897.045483:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.045487:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed524453 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd573f expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.045496:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cf800, rc 0) 00000100:00100000:2.0:1775764897.045575:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:51209:x1862023076179968:12345-192.168.202.58@tcp:101:bash.0 Request processed in 555us (1988us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764897.045584:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6692 00000100:00100000:2.0:1775764897.053319:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.053387:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180096 00000100:00100000:1.0:1775764897.053401:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180096 00000100:00100000:1.0:1775764897.053479:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6693 00000100:00100000:1.0:1775764897.053490:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+53:51210:x1862023076180096:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:1.0:1775764897.053527:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764897.053553:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed524468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5746 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.053628:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed52446f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.053657:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed52446f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.053669:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed52446f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764897.053718:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1775764897.053738:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764897.053936:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed52446f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.053967:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e000/0x6e98bd47ed524468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5746 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.053983:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f200/0x6e98bd47ed52446f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5746 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.053991:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:1.0:1775764897.053993:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764897.053996:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403f200, rc 0) 00000100:00100000:1.0:1775764897.054068:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+54:51210:x1862023076180096:12345-192.168.202.58@tcp:101:rm.0 Request processed in 580us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764897.054075:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6693 00000100:00100000:0.0:1775764897.056342:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.056517:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180224 00000100:00100000:2.0:1775764897.056527:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180224 00000100:00100000:2.0:1775764897.056606:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6694 00000100:00100000:2.0:1775764897.056615:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+54:51210:x1862023076180224:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764897.056638:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764897.056657:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd574d expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.056717:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.056940:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.056954:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.056978:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.056987:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.056994:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057174:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52448b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057181:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52448b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057186:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52448b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764897.057228:0:14288:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 4096 00000004:00200000:2.0:1775764897.057231:0:14288:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764897.057253:0:14288:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52448b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057267:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057273:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057280:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057297:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cfc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.057302:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057311:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057327:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96c1c2b83700) 00010000:00010000:2.0:1775764897.057329:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.057333:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057338:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfc00/0x6e98bd47ed52447d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057350:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057353:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057357:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057360:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43cea00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.057361:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057364:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057376:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb3ca0e89 (ffff96c2c7e0f300) 00010000:00010000:2.0:1775764897.057378:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.057380:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057384:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cea00/0x6e98bd47ed524484 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb3ca0e89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057404:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cfe00/0x6e98bd47ed524476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd574d expref: 56 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057413:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cee00/0x6e98bd47ed52448b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd574d expref: 55 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.057418:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:2.0:1775764897.057419:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1775764897.057421:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cee00, rc 0) 00000100:00100000:2.0:1775764897.057500:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:51210:x1862023076180224:12345-192.168.202.58@tcp:101:rm.0 Request processed in 885us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764897.057508:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6694 00000100:00100000:2.0:1775764897.059990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764897.060082:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180352 00000100:00100000:3.0:1775764897.060094:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180352 00000100:00100000:3.0:1775764897.060151:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6695 00000100:00100000:3.0:1775764897.060163:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:51210:x1862023076180352:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:3.0:1775764897.060190:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764897.060213:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed524492 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5754 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060304:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060321:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060539:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060555:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060561:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060580:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060623:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060628:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060633:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060636:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060640:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1a00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764897.060644:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060648:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060658:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:3.0:1775764897.060659:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764897.060663:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060667:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1a00/0x6e98bd47ed524499 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060678:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060686:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060689:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060692:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c2ff8c1c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:3.0:1775764897.060693:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060696:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060700:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c1c2a03b00) 00010000:00010000:3.0:1775764897.060702:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764897.060703:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060706:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c1c00/0x6e98bd47ed5244a0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.060752:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed524492 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5754 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.061002:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:3.0:1775764897.061003:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1775764897.061006:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c2ff8c0800/0x6e98bd47ed524492 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5754 expref: 56 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.061025:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc 0) 00000100:00100000:3.0:1775764897.061142:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:51210:x1862023076180352:12345-192.168.202.58@tcp:101:rm.0 Request processed in 980us (1160us total) trans 0 rc 301/301 00000100:00100000:3.0:1775764897.061151:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6695 00000100:00100000:3.0:1775764897.065340:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.065411:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180480 00000100:00100000:2.0:1775764897.065422:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180480 00000100:00100000:2.0:1775764897.065529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6696 00000100:00100000:2.0:1775764897.065539:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c4d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:51210:x1862023076180480:12345-192.168.202.58@tcp:101:rm.0 00010000:00010000:2.0:1775764897.065561:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764897.065585:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5244a7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd575b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065669:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 3/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065683:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065693:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065706:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065710:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065715:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065805:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065813:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065819:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065826:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065833:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c43ce000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.065844:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065852:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065867:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:2.0:1775764897.065871:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.065877:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 3/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065946:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43ce000/0x6e98bd47ed5244ae lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065959:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065963:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065967:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065970:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3c00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.065971:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065974:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c1c4135f00) 00010000:00010000:2.0:1775764897.065981:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.065987:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.065991:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3c00/0x6e98bd47ed5244b5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.066021:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5244a7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd575b expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.066031:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:2.0:1775764897.066034:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.066037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c43cf800/0x6e98bd47ed5244a7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd575b expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.066046:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c43cf800, rc 0) 00000100:00100000:2.0:1775764897.066332:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c4d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+55:51210:x1862023076180480:12345-192.168.202.58@tcp:101:rm.0 Request processed in 785us (993us total) trans 0 rc 301/301 00000100:00100000:2.0:1775764897.066341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6696 00000100:00100000:0.0:1775764897.081411:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.081545:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180608 00000100:00100000:1.0:1775764897.081556:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180608 00000100:00100000:1.0:1775764897.081639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6697 00000100:00100000:1.0:1775764897.081649:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:51211:x1862023076180608:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:1.0:1775764897.081680:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764897.081738:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5244bc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5762 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.081869:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082101:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082113:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082128:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082133:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082137:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082183:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082190:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082197:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082204:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082211:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403e200 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764897.082222:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082231:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082257:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:1.0:1775764897.082268:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764897.082274:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082281:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244c3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082295:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082300:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082304:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082307:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764897.082310:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082315:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082320:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c2c7e0f800) 00010000:00010000:1.0:1775764897.082321:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764897.082328:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ca lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082362:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5244bc lrc: 1/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5762 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082369:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:1.0:1775764897.082371:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764897.082373:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403fe00/0x6e98bd47ed5244bc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5762 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.082379:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403fe00, rc 0) 00000100:00100000:1.0:1775764897.082446:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c71afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2bb64567-481f-43c2-999a-8c9c071338ae+55:51211:x1862023076180608:12345-192.168.202.58@tcp:101:cp.0 Request processed in 798us (1046us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764897.082455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6697 00000100:00100000:1.0:1775764897.094024:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764897.095519:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180736 00000100:00100000:0.0:1775764897.095532:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180736 00000100:00100000:0.0:1775764897.095613:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6698 00000100:00100000:0.0:1775764897.095624:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:51211:x1862023076180736:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764897.095645:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764897.095666:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5244d1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5769 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.095746:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.095800:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.095814:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.095831:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.095839:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.095846:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096000:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096008:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096015:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096020:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2cc00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764897.096025:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096150:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096163:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:0.0:1775764897.096315:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764897.096320:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096326:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2cc00/0x6e98bd47ed5244d8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096340:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096345:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096351:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096356:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c1c2ca00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:0.0:1775764897.096358:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096363:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096371:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c2c894cf00) 00010000:00010000:0.0:1775764897.096374:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764897.096376:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096381:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2ca00/0x6e98bd47ed5244df lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096415:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5244d1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5769 expref: 56 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096433:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:0.0:1775764897.096435:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1775764897.096439:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5244d1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5769 expref: 56 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.096449:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2c600, rc 0) 00000100:00100000:0.0:1775764897.096516:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2bb64567-481f-43c2-999a-8c9c071338ae+55:51211:x1862023076180736:12345-192.168.202.58@tcp:101:cp.0 Request processed in 894us (2515us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764897.096522:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6698 00000100:00100000:3.0:1775764897.102002:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764897.102439:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076180992 00000100:00100000:0.0:1775764897.102454:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076180992 00000100:00100000:0.0:1775764897.102530:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6699 00000100:00100000:0.0:1775764897.102549:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+55:51211:x1862023076180992:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764897.102569:0:24980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764897.102590:0:24980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5244e6 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5770 expref: -99 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.102832:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 3/0,1 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.102855:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.102870:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.102946:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244f4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.102978:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244f4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.102985:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244f4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1775764897.105048:0:24980:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x59:0x0], index 1: 0 00010000:00010000:1.0:1775764897.105247:0:24980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed5244fb lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105265:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed5244fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105278:0:24980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed5244fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105316:0:24980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105324:0:24980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105330:0:24980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105337:0:24980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105342:0:24980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c403f000 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:1.0:1775764897.105347:0:24980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105372:0:24980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105386:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:1.0:1775764897.105389:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1775764897.105394:0:24980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 3/0,0 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105400:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403f000/0x6e98bd47ed5244ed lrc: 0/0,0 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1775764897.105414:0:24980:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000086f2f0a1 reply state 000000004c12187b transno 4294970732 ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244f4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105424:0:24980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e200/0x6e98bd47ed5244f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105431:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c2c7e0f800) 00010000:00010000:1.0:1775764897.105433:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1775764897.105436:0:24980:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1775764897.105474:0:24980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c1c2c600/0x6e98bd47ed5244e6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5770 expref: 58 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105491:0:24980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ee00/0x6e98bd47ed5244fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5770 expref: 57 pid: 24980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.105498:0:24980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa3:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:1.0:1775764897.105500:0:24980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1775764897.105502:0:24980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403ee00, rc 0) 00000100:00100000:1.0:1775764897.105590:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+58:51211:x1862023076180992:12345-192.168.202.58@tcp:101:cp.0 Request processed in 3042us (3601us total) trans 4294970732 rc 0/0 00000100:00100000:1.0:1775764897.105599:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6699 00000100:00100000:1.0:1775764897.110445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764897.110510:0:8405:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076181120 00000100:00100000:0.0:1775764897.110520:0:8405:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076181120 00000100:00100000:0.0:1775764897.110716:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1770 00000100:00100000:0.0:1775764897.110740:0:8405:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+8:2410:x1862023076181120:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:0.0:1775764897.110760:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764897.110813:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5777 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764897.110909:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1775764897.110933:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764897.110936:0:8405:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764897.110945:0:8405:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.110965:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.110979:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2ca00, rc 0) 00000100:00100000:0.0:1775764897.111240:0:8405:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2bb64567-481f-43c2-999a-8c9c071338ae+9:2410:x1862023076181120:12345-192.168.202.58@tcp:101:cp.0 Request processed in 503us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764897.111249:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1770 00000100:00080000:2.0:1775764897.111451:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1775764897.114877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764897.115412:0:8641:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076181248 00000100:00100000:3.0:1775764897.115426:0:8641:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076181248 00000100:00100000:3.0:1775764897.115499:0:8641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1771 00000100:00100000:3.0:1775764897.115511:0:8641:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+9:51211:x1862023076181248:12345-192.168.202.58@tcp:101:cp.0 00010000:00010000:3.0:1775764897.115537:0:8641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1775764897.115563:0:8641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd577e expref: -99 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.115604:0:8641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.115697:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764897.115700:0:8641:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1775764897.115705:0:8641:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 10 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.115763:0:8641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1775764897.115842:0:8641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 1504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764897.115861:0:8641:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c3773800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099859456:192.168.202.58@tcp:104: 00000100:00100000:3.0:1775764897.116540:0:8641:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c36d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1775764897.121097:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.121638:0:8641:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c3773800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8641:1862023099859456:192.168.202.58@tcp:104: 00010000:00010000:1.0:1775764897.121679:0:8641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 10 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.121703:0:8641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c2ff8c0800, rc 0) 00000100:00100000:0.0:1775764897.121842:0:6505:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076181376 00000100:00100000:1.0:1775764897.121846:0:8641:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2bb64567-481f-43c2-999a-8c9c071338ae+10:51211:x1862023076181248:12345-192.168.202.58@tcp:101:cp.0 Request processed in 6335us (6978us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764897.121856:0:6505:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076181376 00000100:00100000:1.0:1775764897.121862:0:8641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1771 00010000:00010000:0.0:1775764897.122166:0:6505:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 1504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764897.122338:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1448 00000100:00100000:0.0:1775764897.122350:0:6505:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c2d32d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+10:2411:x1862023076181376:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764897.122369:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764897.122395:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 1504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.122434:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 1504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.122462:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524509 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5777 expref: 10 pid: 8405 timeout: 1504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.122480:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764897.122482:0:6505:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1775764897.122491:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.122502:0:6505:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.122547:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764897.122564:0:6505:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1862023099859584:192.168.202.58@tcp:105: 00000100:00100000:0.0:1775764897.122654:0:6505:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2c3640600 going to sleep for 11 seconds 00000100:00100000:3.0:1775764897.137366:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764897.137461:0:6505:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1862023099859584:192.168.202.58@tcp:105: 00010000:00010000:0.0:1775764897.137487:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764897.137572:0:6505:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c2d32d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2411:x1862023076181376:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 15223us (16491us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764897.137584:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1448 00000100:00100000:1.0:1775764897.138154:0:6524:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076181632 00000100:00100000:1.0:1775764897.138281:0:6524:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076181632 00000100:00100000:1.0:1775764897.138335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1392 00000100:00100000:1.0:1775764897.138343:0:6524:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+58:51211:x1862023076181632:12345-192.168.202.58@tcp:35:cp.0 00000100:00100000:1.0:1775764897.138619:0:6524:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:51211:x1862023076181632:12345-192.168.202.58@tcp:35:cp.0 Request processed in 276us (1266us total) trans 4294970733 rc 0/0 00000100:00100000:1.0:1775764897.138627:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1392 00000100:00100000:3.0:1775764897.176342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764897.176573:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076181760 00000100:00100000:2.0:1775764897.176586:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076181760 00000100:00100000:2.0:1775764897.176675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6700 00000100:00100000:2.0:1775764897.176687:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+45:51214:x1862023076181760:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:2.0:1775764897.176717:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764897.176756:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524517 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5785 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.176920:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.176954:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.176969:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.176983:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.176991:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.176998:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177102:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed52452c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177110:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed52452c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177117:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed52452c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764897.177165:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa3:0x0]: returning size 1516 00000004:00200000:2.0:1775764897.177170:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1775764897.177194:0:6521:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed52452c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177208:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed52452c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177228:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177234:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177240:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177246:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177253:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e3400 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.177259:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177267:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177282:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:2.0:1775764897.177285:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.177290:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 3/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177297:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3400/0x6e98bd47ed52451e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177314:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177320:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177333:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177339:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96c1c51e2e00 already unused, calling callback (ffffffffc18184f0) 00010000:00010000:2.0:1775764897.177341:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177348:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177355:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x9ec36453 (ffff96c2c7e0f800) 00010000:00010000:2.0:1775764897.177358:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1775764897.177361:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177367:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2e00/0x6e98bd47ed524525 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19:0x0].0x9ec36453 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3a00/0x6e98bd47ed524517 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5785 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177416:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3800/0x6e98bd47ed52452c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5785 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764897.177424:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa3:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:2.0:1775764897.177426:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764897.177428:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3800, rc 0) 00000100:00100000:2.0:1775764897.177508:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:51214:x1862023076181760:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 824us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1775764897.177525:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6700 00000100:00100000:2.0:1775764897.183510:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764897.183965:0:8403:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076181888 00000100:00100000:0.0:1775764897.183979:0:8403:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076181888 00000100:00080000:2.0:1775764897.184057:0:6517:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1775764897.184070:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1772 00000100:00100000:0.0:1775764897.184078:0:8403:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076181888:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:0.0:1775764897.184101:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1775764897.184120:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524533 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd578c expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764897.184176:0:8403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1862023099859712:192.168.202.58@tcp:106: 00000100:00100000:0.0:1775764897.184276:0:8403:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c2d0b02f00 going to sleep for 11 seconds 00002000:00010000:0.0:1775764897.190358:0:8403:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb size: 0 -> 1516 00002000:00010000:0.0:1775764897.190370:0:8403:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb mtime: 0 -> 1775764896 00002000:00010000:0.0:1775764897.190373:0:8403:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb atime: 0 -> 1775764896 00002000:00010000:0.0:1775764897.190375:0:8403:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb ctime: 0 -> 1775764896 00002000:00010000:0.0:1775764897.190377:0:8403:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x2c0000401:0x59:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1775764897.190407:0:8403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1862023099859712:192.168.202.58@tcp:106: 00010000:00010000:0.0:1775764897.190458:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524533 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd578c expref: 11 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.190491:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524533 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd578c expref: 11 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764897.190507:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c1c2ca00, rc 0) 00000100:00100000:0.0:1775764897.190591:0:8403:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076181888:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 6512us (7095us total) trans 0 rc 301/301 00000100:00100000:0.0:1775764897.190602:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1772 00000100:00100000:3.0:1775764897.196621:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.196687:0:6522:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076182016 00000100:00100000:1.0:1775764897.196700:0:6522:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076182016 00000100:00100000:1.0:1775764897.196863:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6701 00000100:00100000:1.0:1775764897.196875:0:6522:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+46:51214:x1862023076182016:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764897.196904:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764897.196930:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed52453a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd5793 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.197042:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed524541 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.197059:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed524541 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.197075:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed524541 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1775764897.197140:0:6522:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x19:0x0]: returning size 4096 00000004:00200000:1.0:1775764897.197145:0:6522:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1775764897.197171:0:6522:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed524541 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.197203:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403ea00/0x6e98bd47ed52453a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5793 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.197225:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c403e600/0x6e98bd47ed524541 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd5793 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.197235:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19:0x0].0x0 (ffff96c2c7e0fc00) 00010000:00010000:1.0:1775764897.197238:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1775764897.197242:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403e600, rc 0) 00000100:00100000:1.0:1775764897.197329:0:6522:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:51214:x1862023076182016:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 456us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1775764897.197337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6701 00000100:00100000:2.0:1775764897.203389:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:1.0:1775764897.203562:0:24969:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076182144 00000100:00100000:1.0:1775764897.203574:0:24969:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076182144 00000100:00100000:1.0:1775764897.203729:0:24969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1773 00000100:00100000:1.0:1775764897.203741:0:24969:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076182144:12345-192.168.202.58@tcp:101:lfs.0 00010000:00010000:1.0:1775764897.203766:0:24969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1775764897.203808:0:24969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed524548 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd579a expref: -99 pid: 24969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1775764897.204312:0:24969:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099859840:192.168.202.58@tcp:106: 00000100:00100000:1.0:1775764897.204478:0:24969:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c34af180 going to sleep for 11 seconds 00000100:00100000:1.0:1775764897.216234:0:24969:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24969:1862023099859840:192.168.202.58@tcp:106: 00010000:00010000:1.0:1775764897.216290:0:24969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed524548 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd579a expref: 11 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.216321:0:24969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a741880b/0x6e98bd47ed524548 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd579a expref: 11 pid: 24969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1775764897.216336:0:24969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c403ea00, rc 0) 00000100:00100000:1.0:1775764897.216473:0:24969:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+10:2410:x1862023076182144:12345-192.168.202.58@tcp:101:lfs.0 Request processed in 12732us (13096us total) trans 0 rc 301/301 00000100:00100000:1.0:1775764897.216484:0:24969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 1773 00000100:00100000:3.0:1775764897.221493:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764897.221611:0:14288:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076182400 00000100:00100000:0.0:1775764897.221624:0:14288:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076182400 00000100:00100000:0.0:1775764897.221698:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6702 00000100:00100000:0.0:1775764897.221710:0:14288:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:51214:x1862023076182400:12345-192.168.202.58@tcp:58:lfs.0 00000040:00080000:0.0:1775764897.221992:0:14288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].159, 136 off29608 00000100:00100000:0.0:1775764897.222101:0:14288:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:11b6e21a-ce9d-4bf4-8cc8-5d154b257af0+47:51214:x1862023076182400:12345-192.168.202.58@tcp:58:lfs.0 Request processed in 392us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764897.222109:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6702 00010000:00010000:0.0:1775764897.650047:0:9476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1775764897.716540:0:33623:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1775764897.716548:0:33623:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1775764897.716586:0:33623:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 160 count 3 00000040:00080000:2.0:1775764897.716593:0:33623:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1775764897.842447:0:33136:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1775764897.842457:0:33136:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1775764897.843042:0:33136:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1775764897.843054:0:33136:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1775764898.034005:0:33086:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1775764898.034014:0:33086:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1775764898.034047:0:33086:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 160 count 3 00000040:00080000:1.0:1775764898.034056:0:33086:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1775764898.034269:0:33086:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:33086:1862023099859968:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764898.034398:0:33086:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c34afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1775764898.038981:0:33086:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c1c2aa4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:33086:1862023099859968:192.168.202.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1775764898.042890:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:3.0:1775764898.043360:0:24980:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076182528 00000100:00100000:3.0:1775764898.043376:0:24980:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076182528 00000100:00100000:3.0:1775764898.043466:0:24980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6703 00000100:00100000:3.0:1775764898.043479:0:24980:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+59:51226:x1862023076182528:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1775764898.043530:0:24980:0:(mdt_handler.c:7957:mdt_fid2path()) path get [0x200000403:0xa3:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1775764898.043691:0:24980:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c2aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2bb64567-481f-43c2-999a-8c9c071338ae+59:51226:x1862023076182528:12345-192.168.202.58@tcp:53:lhsmtool_posix.0 Request processed in 215us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1775764898.043699:0:24980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6703 00000100:00100000:3.0:1775764898.046135:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:2.0:1775764898.046265:0:6521:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076182784 00000100:00100000:2.0:1775764898.046276:0:6521:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076182784 00000100:00100000:2.0:1775764898.046336:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 6704 00000100:00100000:2.0:1775764898.046346:0:6521:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+59:51226:x1862023076182784:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1775764898.046369:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1775764898.046394:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed52454f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c81b888c3dd57a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764898.046520:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed524556 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764898.046538:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed524556 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764898.046553:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed524556 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1775764898.046565:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xa3:0x0]: returning size 1516 00010000:00010000:2.0:1775764898.046690:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e2a00/0x6e98bd47ed52454f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd57a1 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764898.046741:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed524556 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd57a1 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1775764898.046750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa3:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:2.0:1775764898.046753:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1775764898.046758:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96c1c51e3e00, rc 0) 00000100:00100000:2.0:1775764898.046940:0:6521:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2bb64567-481f-43c2-999a-8c9c071338ae+61:51226:x1862023076182784:12345-192.168.202.58@tcp:101:lhsmtool_posix.0 Request processed in 594us (813us total) trans 4294970734 rc 0/0 00000100:00100000:2.0:1775764898.046948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 6704 00000100:00100000:2.0:1775764898.049183:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764898.049278:0:8419:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076182912 00000100:00100000:0.0:1775764898.049287:0:8419:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076182912 00000100:00100000:0.0:1775764898.049375:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 765 00000100:00100000:0.0:1775764898.049386:0:8419:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+61:2408:x1862023076182912:12345-192.168.202.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1775764898.049401:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1775764898.049427:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96c1c51e3e00/0x6e98bd47ed524556 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd57a1 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764898.049446:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa3:0x0].0x0 (ffff96c2c7e0f700) 00010000:00010000:0.0:1775764898.049452:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1775764898.049511:0:8419:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff96c1c3664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2bb64567-481f-43c2-999a-8c9c071338ae+60:2408:x1862023076182912:12345-192.168.202.58@tcp:103:ldlm_bl.0 Request processed in 127us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1775764898.049519:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.58@tcp, seq: 765 00000100:00100000:1.0:1775764898.050114:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764898.050174:0:8402:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076183040 00000100:00100000:0.0:1775764898.050192:0:8402:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076183040 00000100:00100000:0.0:1775764898.050244:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 1774 00000100:00100000:0.0:1775764898.050253:0:8402:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c2aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2bb64567-481f-43c2-999a-8c9c071338ae+9:2409:x1862023076183040:12345-192.168.202.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1775764898.050296:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524564 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764898.050318:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764898.050327:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1775764898.050329:0:8402:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1775764898.050333:0:8402:0:(ldlm_resource.c:1714:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524564 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764898.050366:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 9 pid: 8641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764898.050378:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 9 pid: 8641 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1775764898.050392:0:8402:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff96c2f98f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099860096:192.168.202.58@tcp:104: 00000100:00100000:0.0:1775764898.050454:0:8402:0:(client.c:2691:ptlrpc_set_wait()) set ffff96c1c3f22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1775764898.052743:0:8402:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff96c2f98f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8402:1862023099860096:192.168.202.58@tcp:104: 00010000:00010000:0.0:1775764898.052800:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d3b35e7/0x6e98bd47ed524564 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1775764898.053462:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.58@tcp (source: 12345-192.168.202.58@tcp) 00000100:00100000:0.0:1775764898.053512:0:16794:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1862023076183168 00000100:00100000:0.0:1775764898.053520:0:16794:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1862023076183168 00002000:00100000:0.0:1775764898.053571:0:16794:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x59:0x0] (0->1515) req@ffff96c1c3773b80 x1862023076183168/t0(0) o4->2bb64567-481f-43c2-999a-8c9c071338ae@192.168.202.58@tcp:379/0 lens 2008/0 e 0 to 0 dl 1775764909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1775764898.053582:0:16794:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96c1c3773b80 with x1862023076183168 ext(0->1515) 00010000:00010000:0.0:1775764898.053590:0:16794:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 10 pid: 8641 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1775764898.053604:0:16794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a30fa2eb/0x6e98bd47ed524510 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.58@tcp remote: 0x7c81b888c3dd577e expref: 10 pid: 8641 timeout: 1505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1775764898.053611:0:16794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96c1c3773b80 00000100:00100000:3.0:1775764898.053677:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.58@tcp, seq: 38 00000100:00100000:3.0:1775764898.053693:0:8409:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff96c1c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2bb64567-481f-43c2-999a-8c9c071338ae+10:2410:x1862023076183168:12345-192.168.202.58@tcp:4:cp.0 Debug log: 26019 lines, 26019 kept, 0 dropped, 0 bad.